Apr 14 16:59:09 user nova-compute[71689]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 16:59:11 user nova-compute[71689]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71689) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 16:59:11 user nova-compute[71689]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71689) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 16:59:11 user nova-compute[71689]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71689) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 16:59:11 user nova-compute[71689]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 16:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:59:12 user nova-compute[71689]: INFO nova.virt.driver [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 16:59:12 user nova-compute[71689]: INFO nova.compute.provider_config [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Acquiring lock "singleton_lock" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Acquired lock "singleton_lock" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Releasing lock "singleton_lock" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Full set of CONF: {{(pid=71689) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ******************************************************************************** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Configuration options gathered from: {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ================================================================================ {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] allow_resize_to_same_host      = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] arq_binding_timeout            = 300 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] backdoor_port                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] backdoor_socket                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] block_device_allocate_retries  = 300 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] block_device_allocate_retries_interval = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cert                           = self.pem {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute_monitors               = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] config_dir                     = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] config_drive_format            = iso9660 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] config_source                  = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] console_host                   = user {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] control_exchange               = nova {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cpu_allocation_ratio           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] daemon                         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] debug                          = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] default_access_ip_network_name = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] default_availability_zone      = nova {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] default_ephemeral_format       = ext4 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] default_schedule_zone          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] disk_allocation_ratio          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] enable_new_services            = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] enabled_apis                   = ['osapi_compute'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] enabled_ssl_apis               = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] flat_injected                  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] force_config_drive             = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] force_raw_images               = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] graceful_shutdown_timeout      = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] heal_instance_info_cache_interval = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] host                           = user {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_build_timeout         = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_delete_interval       = 300 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_format                = [instance: %(uuid)s]  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_name_template         = instance-%08x {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_usage_audit           = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_usage_audit_period    = month {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] internal_service_availability_zone = internal {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] key                            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] live_migration_retry_count     = 30 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_config_append              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_dir                        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_file                       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_options                    = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_rotate_interval            = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_rotate_interval_type       = days {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] log_rotation_type              = none {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] long_rpc_timeout               = 1800 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] max_concurrent_builds          = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] max_concurrent_live_migrations = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] max_concurrent_snapshots       = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] max_local_block_devices        = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] max_logfile_count              = 30 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] max_logfile_size_mb            = 200 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] maximum_instance_delete_attempts = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metadata_listen                = 0.0.0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metadata_listen_port           = 8775 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metadata_workers               = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] migrate_max_retries            = -1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] mkisofs_cmd                    = genisoimage {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] my_ip                          = 10.0.0.210 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] network_allocate_retries       = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] osapi_compute_listen_port      = 8774 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] osapi_compute_unique_server_name_scope =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] osapi_compute_workers          = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] password_length                = 12 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] periodic_enable                = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] periodic_fuzzy_delay           = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] pointer_model                  = ps2mouse {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] preallocate_images             = none {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] publish_errors                 = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] pybasedir                      = /opt/stack/nova {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ram_allocation_ratio           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rate_limit_burst               = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rate_limit_except_level        = CRITICAL {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rate_limit_interval            = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reboot_timeout                 = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reclaim_instance_interval      = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] record                         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reimage_timeout_per_gb         = 20 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] report_interval                = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rescue_timeout                 = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reserved_host_cpus             = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reserved_host_disk_mb          = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reserved_host_memory_mb        = 512 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] reserved_huge_pages            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] resize_confirm_window          = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] resize_fs_using_block_device   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] resume_guests_state_on_host_boot = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rpc_response_timeout           = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] run_external_periodic_tasks    = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] running_deleted_instance_action = reap {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] running_deleted_instance_poll_interval = 1800 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] running_deleted_instance_timeout = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler_instance_sync_interval = 120 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_down_time              = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] servicegroup_driver            = db {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] shelved_offload_time           = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] shelved_poll_interval          = 3600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] shutdown_timeout               = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] source_is_ipv6                 = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ssl_only                       = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] state_path                     = /opt/stack/data/nova {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] sync_power_state_interval      = 600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] sync_power_state_pool_size     = 1000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] syslog_log_facility            = LOG_USER {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] tempdir                        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] timeout_nbd                    = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] transport_url                  = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] update_resources_interval      = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_cow_images                 = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_eventlog                   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_journal                    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_json                       = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_rootwrap_daemon            = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_stderr                     = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] use_syslog                     = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vcpu_pin_set                   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plugging_is_fatal          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plugging_timeout           = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] virt_mkfs                      = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] volume_usage_poll_interval     = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] watch_log_file                 = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] web                            = /usr/share/spice-html5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_concurrency.disable_process_locking = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.auth_strategy              = keystone {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.compute_link_prefix        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.dhcp_domain                = novalocal {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.enable_instance_password   = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.glance_link_prefix         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.instance_list_per_project_cells = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.list_records_by_skipping_down_cells = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.local_metadata_per_cell    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.max_limit                  = 1000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.metadata_cache_expiration  = 15 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.neutron_default_tenant_id  = default {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.use_forwarded_for          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.use_neutron_default_nets   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_dynamic_targets = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_jsonfile_path   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.backend                  = dogpile.cache.memcached {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.backend_argument         = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.config_prefix            = cache.oslo {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.dead_timeout             = 60.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.debug_cache_backend      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.enable_retry_client      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.enable_socket_keepalive  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.enabled                  = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.expiration_time          = 600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.hashclient_retry_attempts = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_dead_retry      = 300 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_password        =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_pool_maxsize    = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_sasl_enabled    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.memcache_username        =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.proxies                  = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.retry_attempts           = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.retry_delay              = 0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.socket_keepalive_count   = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.socket_keepalive_idle    = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.socket_keepalive_interval = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.tls_allowed_ciphers      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.tls_cafile               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.tls_certfile             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.tls_enabled              = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cache.tls_keyfile              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.auth_section            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.auth_type               = password {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.cafile                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.certfile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.collect_timing          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.cross_az_attach         = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.debug                   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.endpoint_template       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.http_retries            = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.insecure                = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.keyfile                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.os_region_name          = RegionOne {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.split_loggers           = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cinder.timeout                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.cpu_dedicated_set      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.cpu_shared_set         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.image_type_exclude_list = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.max_concurrent_disk_ops = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.max_disk_devices_to_attach = -1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.resource_provider_association_refresh = 300 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.shutdown_retry_interval = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] conductor.workers              = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] console.allowed_origins        = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] console.ssl_ciphers            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] console.ssl_minimum_version    = default {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] consoleauth.token_ttl          = 600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.cafile                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.certfile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.collect_timing          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.connect_retries         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.connect_retry_delay     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.endpoint_override       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.insecure                = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.keyfile                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.max_version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.min_version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.region_name             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.service_name            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.service_type            = accelerator {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.split_loggers           = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.status_code_retries     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.timeout                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] cyborg.version                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.backend               = sqlalchemy {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.connection            = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.connection_debug      = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.connection_parameters =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.connection_recycle_time = 3600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.connection_trace      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.db_inc_retry_interval = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.db_max_retries        = 20 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.db_max_retry_interval = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.db_retry_interval     = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.max_overflow          = 50 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.max_pool_size         = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.max_retries           = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.mysql_enable_ndb      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.mysql_wsrep_sync_wait = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.pool_timeout          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.retry_interval        = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.slave_connection      = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] database.sqlite_synchronous    = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.backend           = sqlalchemy {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.connection        = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.connection_debug  = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.connection_parameters =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.connection_recycle_time = 3600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.connection_trace  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.db_inc_retry_interval = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.db_max_retries    = 20 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.db_max_retry_interval = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.db_retry_interval = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.max_overflow      = 50 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.max_pool_size     = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.max_retries       = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.mysql_enable_ndb  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.pool_timeout      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.retry_interval    = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.slave_connection  = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] api_database.sqlite_synchronous = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] devices.enabled_mdev_types     = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ephemeral_storage_encryption.enabled = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.api_servers             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.cafile                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.certfile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.collect_timing          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.connect_retries         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.connect_retry_delay     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.debug                   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.default_trusted_certificate_ids = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.enable_certificate_validation = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.enable_rbd_download     = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.endpoint_override       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.insecure                = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.keyfile                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.max_version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.min_version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.num_retries             = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.rbd_ceph_conf           =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.rbd_connect_timeout     = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.rbd_pool                =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.rbd_user                =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.region_name             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.service_name            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.service_type            = image {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.split_loggers           = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.status_code_retries     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.timeout                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.verify_glance_signatures = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] glance.version                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] guestfs.debug                  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.config_drive_cdrom      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.config_drive_inject_password = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.enable_instance_metrics_collection = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.enable_remotefx         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.instances_path_share    =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.iscsi_initiator_list    = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.limit_cpu_features      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.power_state_check_timeframe = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.use_multipath_io        = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.volume_attach_retry_count = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.vswitch_name            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] mks.enabled                    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] image_cache.manager_interval   = 2400 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] image_cache.precache_concurrency = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] image_cache.remove_unused_base_images = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] image_cache.subdirectory_name  = _base {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.api_max_retries         = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.api_retry_interval      = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.auth_section            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.auth_type               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.cafile                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.certfile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.collect_timing          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.connect_retries         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.connect_retry_delay     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.endpoint_override       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.insecure                = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.keyfile                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.max_version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.min_version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.partition_key           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.peer_list               = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.region_name             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.serial_console_state_timeout = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.service_name            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.service_type            = baremetal {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.split_loggers           = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.status_code_retries     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.timeout                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ironic.version                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] key_manager.fixed_key          = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.barbican_api_version  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.barbican_endpoint     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.barbican_endpoint_type = public {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.barbican_region_name  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.cafile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.certfile              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.collect_timing        = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.insecure              = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.keyfile               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.number_of_retries     = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.retry_delay           = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.send_service_user_token = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.split_loggers         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.timeout               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.verify_ssl            = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican.verify_ssl_path       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.auth_section = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.auth_type = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.cafile   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.certfile = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.collect_timing = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.insecure = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.keyfile  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.split_loggers = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] barbican_service_user.timeout  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.approle_role_id          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.approle_secret_id        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.cafile                   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.certfile                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.collect_timing           = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.insecure                 = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.keyfile                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.kv_mountpoint            = secret {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.kv_version               = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.namespace                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.root_token_id            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.split_loggers            = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.ssl_ca_crt_file          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.timeout                  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.use_ssl                  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.cafile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.certfile              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.collect_timing        = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.connect_retries       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.connect_retry_delay   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.endpoint_override     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.insecure              = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.keyfile               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.max_version           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.min_version           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.region_name           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.service_name          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.service_type          = identity {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.split_loggers         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.status_code_retries   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.timeout               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] keystone.version               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.connection_uri         =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_mode               = custom {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: WARNING oslo_config.cfg [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_power_governor_high = performance {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_power_governor_low = powersave {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_power_management   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.device_detach_attempts = 8 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.device_detach_timeout  = 20 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.disk_cachemodes        = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.disk_prefix            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.enabled_perf_events    = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.file_backed_memory     = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.gid_maps               = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.hw_disk_discard        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.hw_machine_type        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_rbd_glance_store_name =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_rbd_pool        = rbd {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_type            = default {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.images_volume_group    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.inject_key             = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.inject_partition       = -2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.inject_password        = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.iscsi_iface            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.iser_use_multipath     = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_bandwidth = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_downtime = 500 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_inbound_addr = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_permit_post_copy = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_scheme  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_timeout_action = abort {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_tunnelled = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: WARNING oslo_config.cfg [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 16:59:12 user nova-compute[71689]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 16:59:12 user nova-compute[71689]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 16:59:12 user nova-compute[71689]: and ``live_migration_inbound_addr`` respectively.
Apr 14 16:59:12 user nova-compute[71689]: ).  Its value may be silently ignored in the future.
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.live_migration_with_native_tls = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.max_queues             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.nfs_mount_options      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.num_memory_encrypted_guests = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.num_pcie_ports         = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.pmem_namespaces        = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.quobyte_client_cfg     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rbd_secret_uuid        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rbd_user               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.remote_filesystem_transport = ssh {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rescue_image_id        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rescue_kernel_id       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rescue_ramdisk_id      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.rx_queue_size          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.smbfs_mount_options    =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.snapshot_compression   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.snapshot_image_format  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.sparse_logical_volumes = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.swtpm_enabled          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.swtpm_group            = tss {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.swtpm_user             = tss {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.sysinfo_serial         = unique {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.tx_queue_size          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.uid_maps               = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.use_virtio_for_bridges = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.virt_type              = kvm {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.volume_clear           = zero {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.volume_clear_size      = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.volume_use_multipath   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_cache_path   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.vzstorage_mount_user   = stack {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.auth_section           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.auth_type              = password {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.cafile                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.certfile               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.collect_timing         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.connect_retries        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.connect_retry_delay    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.default_floating_pool  = public {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.endpoint_override      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.extension_sync_interval = 600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.http_retries           = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.insecure               = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.keyfile                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.max_version            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.min_version            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.ovs_bridge             = br-int {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.physnets               = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.region_name            = RegionOne {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.service_metadata_proxy = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.service_name           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.service_type           = network {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.split_loggers          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.status_code_retries    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.timeout                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] neutron.version                = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] notifications.bdms_in_notifications = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] notifications.default_level    = INFO {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] notifications.notification_format = unversioned {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] notifications.notify_on_state_change = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] pci.alias                      = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] pci.device_spec                = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] pci.report_in_placement        = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.auth_section         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.auth_type            = password {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.cafile               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.certfile             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.collect_timing       = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.connect_retries      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.connect_retry_delay  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.default_domain_id    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.default_domain_name  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.domain_id            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.domain_name          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.endpoint_override    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.insecure             = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.keyfile              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.max_version          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.min_version          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.password             = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.project_domain_id    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.project_domain_name  = Default {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.project_id           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.project_name         = service {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.region_name          = RegionOne {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.service_name         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.service_type         = placement {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.split_loggers        = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.status_code_retries  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.system_scope         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.timeout              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.trust_id             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.user_domain_id       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.user_domain_name     = Default {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.user_id              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.username             = placement {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] placement.version              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.cores                    = 20 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.count_usage_from_placement = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.injected_file_content_bytes = 10240 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.injected_file_path_length = 255 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.injected_files           = 5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.instances                = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.key_pairs                = 100 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.metadata_items           = 128 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.ram                      = 51200 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.recheck_quota            = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.server_group_members     = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] quota.server_groups            = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rdp.enabled                    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.image_metadata_prefilter = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.max_attempts         = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.max_placement_results = 1000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.query_placement_for_availability_zone = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.query_placement_for_image_type_support = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] scheduler.workers              = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.host_subset_size = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.isolated_hosts = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.isolated_images = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.pci_in_placement = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.track_instance_changes = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metrics.required               = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metrics.weight_multiplier      = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] metrics.weight_setting         = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] serial_console.enabled         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] serial_console.port_range      = 10000:20000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] serial_console.serialproxy_port = 6083 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.auth_section      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.auth_type         = password {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.cafile            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.certfile          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.collect_timing    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.insecure          = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.keyfile           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.send_service_user_token = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.split_loggers     = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] service_user.timeout           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.agent_enabled            = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.enabled                  = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.html5proxy_port          = 6082 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.image_compression        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.jpeg_compression         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.playback_compression     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.server_listen            = 127.0.0.1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.streaming_mode           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] spice.zlib_compression         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] upgrade_levels.baseapi         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] upgrade_levels.cert            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] upgrade_levels.compute         = auto {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] upgrade_levels.conductor       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] upgrade_levels.scheduler       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.auth_section = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.auth_type = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.cafile = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.certfile = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.insecure = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.keyfile = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vendordata_dynamic_auth.timeout = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.api_retry_count         = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.ca_file                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.cache_prefix            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.cluster_name            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.connection_pool_size    = 10 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.console_delay_seconds   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.datastore_regex         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.host_ip                 = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.host_password           = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.host_port               = 443 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.host_username           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.insecure                = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.integration_bridge      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.maximum_objects         = 100 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.pbm_default_policy      = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.pbm_enabled             = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.pbm_wsdl_location       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.serial_port_proxy_uri   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.serial_port_service_uri = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.task_poll_interval      = 0.5 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.use_linked_clone        = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.vnc_keymap              = en-us {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.vnc_port                = 5900 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vmware.vnc_port_total          = 10000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.auth_schemes               = ['none'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.enabled                    = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.novncproxy_port            = 6080 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.server_listen              = 0.0.0.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.vencrypt_ca_certs          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.vencrypt_client_cert       = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vnc.vencrypt_client_key        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.disable_rootwrap   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.enable_numa_live_migration = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.libvirt_disable_apic = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.client_socket_timeout     = 900 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.default_pool_size         = 1000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.keep_alive                = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.max_header_line           = 16384 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.ssl_ca_file               = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.ssl_cert_file             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.ssl_key_file              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.tcp_keepidle              = 600 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] zvm.ca_file                    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] zvm.cloud_connector_url        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] zvm.reachable_timeout          = 300 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.enforce_new_defaults = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.enforce_scope      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.policy_default_rule = default {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.policy_file        = policy.yaml {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.connection_string     = messaging:// {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.enabled               = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.es_doc_type           = notification {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.es_scroll_size        = 10000 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.es_scroll_time        = 2m {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.filter_error_trace    = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.sentinel_service_name = mymaster {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.socket_timeout        = 0.1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] profiler.trace_sqlalchemy      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] remote_debug.host              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] remote_debug.port              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.ssl      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_notifications.retry = -1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_messaging_notifications.transport_url = **** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.auth_section        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.auth_type           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.cafile              = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.certfile            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.collect_timing      = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.connect_retries     = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.connect_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.endpoint_id         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.endpoint_override   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.insecure            = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.keyfile             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.max_version         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.min_version         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.region_name         = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.service_name        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.service_type        = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.split_loggers       = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.status_code_retries = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.status_code_retry_delay = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.timeout             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.valid_interfaces    = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_limit.version             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_reports.file_event_handler = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] oslo_reports.log_dir           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_ovs_privileged.group  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] vif_plug_ovs_privileged.user   = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.flat_interface = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_ovs.isolate_vif         = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_vif_ovs.per_port_bridge     = False {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] os_brick.lock_path             = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] privsep_osbrick.capabilities   = [21] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] privsep_osbrick.group          = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] privsep_osbrick.helper_command = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] privsep_osbrick.user           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] nova_sys_admin.group           = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] nova_sys_admin.helper_command  = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] nova_sys_admin.user            = None {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG oslo_service.service [None req-e6e897d1-eb66-44f8-bbcc-1ac5c6bbfcde None None] ******************************************************************************** {{(pid=71689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 16:59:12 user nova-compute[71689]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Starting native event thread {{(pid=71689) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Starting green dispatch thread {{(pid=71689) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Starting connection event dispatch thread {{(pid=71689) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Connecting to libvirt: qemu:///system {{(pid=71689) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9b552b6620> {{(pid=71689) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9b552b6620> {{(pid=71689) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 16:59:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Connection event '1' reason 'None'
Apr 14 16:59:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 16:59:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.mount [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Initialising _HostMountState generation 0 {{(pid=71689) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 16:59:19 user nova-compute[71689]: INFO nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host capabilities <capabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <host>
Apr 14 16:59:19 user nova-compute[71689]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 16:59:19 user nova-compute[71689]:     <cpu>
Apr 14 16:59:19 user nova-compute[71689]:       <arch>x86_64</arch>
Apr 14 16:59:19 user nova-compute[71689]:       <model>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <microcode version='1070'/>
Apr 14 16:59:19 user nova-compute[71689]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='osxsave'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='invtsc'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='rsba'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 16:59:19 user nova-compute[71689]:       <pages unit='KiB' size='4'/>
Apr 14 16:59:19 user nova-compute[71689]:       <pages unit='KiB' size='2048'/>
Apr 14 16:59:19 user nova-compute[71689]:     </cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <power_management>
Apr 14 16:59:19 user nova-compute[71689]:       <suspend_mem/>
Apr 14 16:59:19 user nova-compute[71689]:       <suspend_disk/>
Apr 14 16:59:19 user nova-compute[71689]:       <suspend_hybrid/>
Apr 14 16:59:19 user nova-compute[71689]:     </power_management>
Apr 14 16:59:19 user nova-compute[71689]:     <iommu support='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <migration_features>
Apr 14 16:59:19 user nova-compute[71689]:       <live/>
Apr 14 16:59:19 user nova-compute[71689]:       <uri_transports>
Apr 14 16:59:19 user nova-compute[71689]:         <uri_transport>tcp</uri_transport>
Apr 14 16:59:19 user nova-compute[71689]:         <uri_transport>rdma</uri_transport>
Apr 14 16:59:19 user nova-compute[71689]:       </uri_transports>
Apr 14 16:59:19 user nova-compute[71689]:     </migration_features>
Apr 14 16:59:19 user nova-compute[71689]:     <topology>
Apr 14 16:59:19 user nova-compute[71689]:       <cells num='2'>
Apr 14 16:59:19 user nova-compute[71689]:         <cell id='0'>
Apr 14 16:59:19 user nova-compute[71689]:           <memory unit='KiB'>8189224</memory>
Apr 14 16:59:19 user nova-compute[71689]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 14 16:59:19 user nova-compute[71689]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 16:59:19 user nova-compute[71689]:           <distances>
Apr 14 16:59:19 user nova-compute[71689]:             <sibling id='0' value='10'/>
Apr 14 16:59:19 user nova-compute[71689]:             <sibling id='1' value='20'/>
Apr 14 16:59:19 user nova-compute[71689]:           </distances>
Apr 14 16:59:19 user nova-compute[71689]:           <cpus num='6'>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 16:59:19 user nova-compute[71689]:           </cpus>
Apr 14 16:59:19 user nova-compute[71689]:         </cell>
Apr 14 16:59:19 user nova-compute[71689]:         <cell id='1'>
Apr 14 16:59:19 user nova-compute[71689]:           <memory unit='KiB'>8218764</memory>
Apr 14 16:59:19 user nova-compute[71689]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 14 16:59:19 user nova-compute[71689]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 16:59:19 user nova-compute[71689]:           <distances>
Apr 14 16:59:19 user nova-compute[71689]:             <sibling id='0' value='20'/>
Apr 14 16:59:19 user nova-compute[71689]:             <sibling id='1' value='10'/>
Apr 14 16:59:19 user nova-compute[71689]:           </distances>
Apr 14 16:59:19 user nova-compute[71689]:           <cpus num='6'>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 16:59:19 user nova-compute[71689]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 16:59:19 user nova-compute[71689]:           </cpus>
Apr 14 16:59:19 user nova-compute[71689]:         </cell>
Apr 14 16:59:19 user nova-compute[71689]:       </cells>
Apr 14 16:59:19 user nova-compute[71689]:     </topology>
Apr 14 16:59:19 user nova-compute[71689]:     <cache>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 16:59:19 user nova-compute[71689]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 16:59:19 user nova-compute[71689]:     </cache>
Apr 14 16:59:19 user nova-compute[71689]:     <secmodel>
Apr 14 16:59:19 user nova-compute[71689]:       <model>apparmor</model>
Apr 14 16:59:19 user nova-compute[71689]:       <doi>0</doi>
Apr 14 16:59:19 user nova-compute[71689]:     </secmodel>
Apr 14 16:59:19 user nova-compute[71689]:     <secmodel>
Apr 14 16:59:19 user nova-compute[71689]:       <model>dac</model>
Apr 14 16:59:19 user nova-compute[71689]:       <doi>0</doi>
Apr 14 16:59:19 user nova-compute[71689]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 16:59:19 user nova-compute[71689]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 16:59:19 user nova-compute[71689]:     </secmodel>
Apr 14 16:59:19 user nova-compute[71689]:   </host>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='alpha'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>clipper</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='armv6l'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>spitz</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>nuri</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>kzm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sx1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>z2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>tosa</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>n810</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>n800</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>terrier</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>midway</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>microbit</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>verdex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>highbank</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>akita</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>connex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>collie</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='armv7l'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>spitz</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>nuri</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>kzm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sx1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>z2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>tosa</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>n810</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>n800</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>terrier</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>midway</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>microbit</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>verdex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>highbank</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>akita</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>connex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>collie</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='aarch64'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>spitz</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>nuri</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>kzm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sx1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>z2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>tosa</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>n810</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>n800</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>terrier</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>midway</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>microbit</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>verdex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>highbank</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>akita</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>connex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>collie</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <acpi default='on' toggle='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='cris'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='i686'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>isapc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>microvm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='kvm'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <pae/>
Apr 14 16:59:19 user nova-compute[71689]:       <nonpae/>
Apr 14 16:59:19 user nova-compute[71689]:       <acpi default='on' toggle='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:       <apic default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='m68k'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>an5206</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>q800</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='microblaze'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='microblazeel'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='mips'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='16'>malta</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='mipsel'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='16'>malta</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='mips64'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='16'>malta</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>pica61</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>magnum</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='mips64el'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='16'>malta</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>pica61</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>magnum</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='16'>boston</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='ppc'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mac99</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>40p</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>taihu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='ppc64'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>taihu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>40p</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mac99</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='ppc64le'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>taihu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>40p</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>mac99</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='riscv32'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='8'>spike</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='8'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='riscv64'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='8'>spike</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='8'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='s390x'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='sh4'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>shix</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>r2d</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='sh4eb'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>shix</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>r2d</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='sparc'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>LX</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='sparc64'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>niagara</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='x86_64'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>64</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='1'>isapc</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>microvm</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='kvm'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <acpi default='on' toggle='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:       <apic default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='xtensa'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>sim</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>kc705</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ml605</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx200</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx60</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]:   <guest>
Apr 14 16:59:19 user nova-compute[71689]:     <os_type>hvm</os_type>
Apr 14 16:59:19 user nova-compute[71689]:     <arch name='xtensaeb'>
Apr 14 16:59:19 user nova-compute[71689]:       <wordsize>32</wordsize>
Apr 14 16:59:19 user nova-compute[71689]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='4'>sim</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>kc705</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ml605</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>virt</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx200</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>lx60</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 16:59:19 user nova-compute[71689]:       <domain type='qemu'/>
Apr 14 16:59:19 user nova-compute[71689]:     </arch>
Apr 14 16:59:19 user nova-compute[71689]:     <features>
Apr 14 16:59:19 user nova-compute[71689]:       <cpuselection/>
Apr 14 16:59:19 user nova-compute[71689]:       <deviceboot/>
Apr 14 16:59:19 user nova-compute[71689]:       <disksnapshot default='on' toggle='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     </features>
Apr 14 16:59:19 user nova-compute[71689]:   </guest>
Apr 14 16:59:19 user nova-compute[71689]: </capabilities>
Apr 14 16:59:19 user nova-compute[71689]: 
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-q35-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>i686</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='288'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'/>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='lm'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-q35-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>i686</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='288'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'/>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='lm'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-i440fx-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>i686</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='255'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'/>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='lm'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ide</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-i440fx-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>i686</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='255'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'/>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='lm'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ide</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-q35-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>x86_64</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='288'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>efi</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='invtsc'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='rsba'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-q35-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>x86_64</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='288'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>efi</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='invtsc'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='rsba'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-i440fx-jammy</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>x86_64</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='255'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>efi</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='invtsc'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='rsba'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ide</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 16:59:19 user nova-compute[71689]: <domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 16:59:19 user nova-compute[71689]:   <domain>kvm</domain>
Apr 14 16:59:19 user nova-compute[71689]:   <machine>pc-i440fx-6.2</machine>
Apr 14 16:59:19 user nova-compute[71689]:   <arch>x86_64</arch>
Apr 14 16:59:19 user nova-compute[71689]:   <vcpu max='255'/>
Apr 14 16:59:19 user nova-compute[71689]:   <iothreads supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:   <os supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='firmware'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>efi</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:     <loader supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>rom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pflash</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='readonly'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>yes</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='secure'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>no</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </loader>
Apr 14 16:59:19 user nova-compute[71689]:   </os>
Apr 14 16:59:19 user nova-compute[71689]:   <cpu>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-passthrough' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='hostPassthroughMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='maximum' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='maximumMigratable'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>on</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>off</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='host-model' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <vendor>Intel</vendor>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ss'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='vmx'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pcid'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='hypervisor'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arat'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='umip'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='md-clear'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='invtsc'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibpb'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='ibrs'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-stibp'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='rsba'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='erms'/>
Apr 14 16:59:19 user nova-compute[71689]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:     <mode name='custom' supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>qemu64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>qemu32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>phenom</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>pentium</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>n270</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm64</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>kvm32</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>coreduo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>core2duo</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>athlon</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Westmere</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Snowridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Skylake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>SandyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Penryn</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G5</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G4</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G3</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Opteron_G2</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Opteron_G1</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>IvyBridge</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Icelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Haswell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Rome</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-Milan</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>EPYC</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Dhyana</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cooperlake</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>Conroe</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='no'>Broadwell</model>
Apr 14 16:59:19 user nova-compute[71689]:       <model usable='yes'>486</model>
Apr 14 16:59:19 user nova-compute[71689]:     </mode>
Apr 14 16:59:19 user nova-compute[71689]:   </cpu>
Apr 14 16:59:19 user nova-compute[71689]:   <memoryBacking supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:     <enum name='sourceType'>
Apr 14 16:59:19 user nova-compute[71689]:       <value>file</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>anonymous</value>
Apr 14 16:59:19 user nova-compute[71689]:       <value>memfd</value>
Apr 14 16:59:19 user nova-compute[71689]:     </enum>
Apr 14 16:59:19 user nova-compute[71689]:   </memoryBacking>
Apr 14 16:59:19 user nova-compute[71689]:   <devices>
Apr 14 16:59:19 user nova-compute[71689]:     <disk supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='diskDevice'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>disk</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cdrom</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>floppy</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>lun</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='bus'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ide</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>fdc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sata</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </disk>
Apr 14 16:59:19 user nova-compute[71689]:     <graphics supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='type'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>sdl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vnc</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>spice</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egl-headless</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </graphics>
Apr 14 16:59:19 user nova-compute[71689]:     <video supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='modelType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>cirrus</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>vmvga</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>qxl</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>none</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>bochs</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>ramfb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </video>
Apr 14 16:59:19 user nova-compute[71689]:     <hostdev supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='mode'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>subsystem</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='startupPolicy'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>default</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>mandatory</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>requisite</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>optional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='subsysType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>usb</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>pci</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>scsi</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='capsType'/>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='pciBackend'/>
Apr 14 16:59:19 user nova-compute[71689]:     </hostdev>
Apr 14 16:59:19 user nova-compute[71689]:     <rng supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtio-non-transitional</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>random</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>egd</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>builtin</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </rng>
Apr 14 16:59:19 user nova-compute[71689]:     <filesystem supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='driverType'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>path</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>handle</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>virtiofs</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </filesystem>
Apr 14 16:59:19 user nova-compute[71689]:     <tpm supported='yes'>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='model'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-tis</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>tpm-crb</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:       <enum name='backendModel'>
Apr 14 16:59:19 user nova-compute[71689]:         <value>passthrough</value>
Apr 14 16:59:19 user nova-compute[71689]:         <value>emulator</value>
Apr 14 16:59:19 user nova-compute[71689]:       </enum>
Apr 14 16:59:19 user nova-compute[71689]:     </tpm>
Apr 14 16:59:19 user nova-compute[71689]:   </devices>
Apr 14 16:59:19 user nova-compute[71689]:   <features>
Apr 14 16:59:19 user nova-compute[71689]:     <gic supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:     <vmcoreinfo supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <genid supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backingStoreInput supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <backup supported='yes'/>
Apr 14 16:59:19 user nova-compute[71689]:     <sev supported='no'/>
Apr 14 16:59:19 user nova-compute[71689]:   </features>
Apr 14 16:59:19 user nova-compute[71689]: </domainCapabilities>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71689) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71689) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Checking secure boot support for host arch (x86_64) {{(pid=71689) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 16:59:19 user nova-compute[71689]: INFO nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Secure Boot support detected
Apr 14 16:59:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] cpu compare xml: <cpu match="exact">
Apr 14 16:59:19 user nova-compute[71689]:   <model>Nehalem</model>
Apr 14 16:59:19 user nova-compute[71689]: </cpu>
Apr 14 16:59:19 user nova-compute[71689]:  {{(pid=71689) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 16:59:19 user nova-compute[71689]: INFO nova.virt.node [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Generated node identity 4b579fd6-14ac-45a2-8022-c2739351dd91
Apr 14 16:59:19 user nova-compute[71689]: INFO nova.virt.node [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Wrote node identity 4b579fd6-14ac-45a2-8022-c2739351dd91 to /opt/stack/data/nova/compute_id
Apr 14 16:59:19 user nova-compute[71689]: WARNING nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Compute nodes ['4b579fd6-14ac-45a2-8022-c2739351dd91'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 16:59:19 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 16:59:20 user nova-compute[71689]: WARNING nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 16:59:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:59:20 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:59:20 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Hypervisor/Node resource view: name=user free_ram=10809MB free_disk=27.12425994873047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:59:20 user nova-compute[71689]: WARNING nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] No compute node record for user:4b579fd6-14ac-45a2-8022-c2739351dd91: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4b579fd6-14ac-45a2-8022-c2739351dd91 could not be found.
Apr 14 16:59:20 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Compute node record created for user:user with uuid: 4b579fd6-14ac-45a2-8022-c2739351dd91
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:59:20 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [req-93a88135-42ec-4b57-94b4-7cdeb72c5bfc] Created resource provider record via placement API for resource provider with UUID 4b579fd6-14ac-45a2-8022-c2739351dd91 and name user.
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71689) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 16:59:20 user nova-compute[71689]: INFO nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] kernel doesn't support AMD SEV
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Libvirt baseline CPU <cpu>
Apr 14 16:59:20 user nova-compute[71689]:   <arch>x86_64</arch>
Apr 14 16:59:20 user nova-compute[71689]:   <model>Nehalem</model>
Apr 14 16:59:20 user nova-compute[71689]:   <vendor>Intel</vendor>
Apr 14 16:59:20 user nova-compute[71689]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 16:59:20 user nova-compute[71689]: </cpu>
Apr 14 16:59:20 user nova-compute[71689]:  {{(pid=71689) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Updated inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Updating resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 generation from 0 to 1 during operation: update_inventory {{(pid=71689) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Updating resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 generation from 1 to 2 during operation: update_traits {{(pid=71689) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:59:20 user nova-compute[71689]: DEBUG nova.service [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Creating RPC server for service compute {{(pid=71689) start /opt/stack/nova/nova/service.py:182}}
Apr 14 16:59:21 user nova-compute[71689]: DEBUG nova.service [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Join ServiceGroup membership for this service compute {{(pid=71689) start /opt/stack/nova/nova/service.py:199}}
Apr 14 16:59:21 user nova-compute[71689]: DEBUG nova.servicegroup.drivers.db [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71689) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 16:59:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:59:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:00:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:00:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=10181MB free_disk=27.038108825683594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:00:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:01:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:01:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:01:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=10155MB free_disk=27.08525848388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:01:12 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:01:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:01:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:01:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:01:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:01:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:02:13 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:02:13 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=10140MB free_disk=26.860355377197266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:02:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:02:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:02:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:02:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:02:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:03:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:03:14 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:14 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=9445MB free_disk=26.891494750976562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:03:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:03:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:03:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:03:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:30 user nova-compute[71689]: INFO nova.compute.claims [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Claim successful on node user
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:30 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:31 user nova-compute[71689]: INFO nova.compute.claims [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Claim successful on node user
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Creating image(s)
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "/opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "/opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.policy [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.part --force-share --output=json" returned: 0 in 0.175s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.virt.images [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] b0124a46-3c94-42d9-9961-82730022fc5b was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.part /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.068s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:31 user nova-compute[71689]: INFO nova.compute.claims [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Claim successful on node user
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.part /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.converted" returned: 0 in 0.173s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.965s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:32 user nova-compute[71689]: INFO oslo.privsep.daemon [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7m1hvf6l/privsep.sock']
Apr 14 17:03:32 user sudo[80420]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7m1hvf6l/privsep.sock
Apr 14 17:03:32 user sudo[80420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Creating image(s)
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.policy [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:32 user nova-compute[71689]: INFO nova.compute.claims [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Claim successful on node user
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Creating image(s)
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Successfully created port: 0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Creating image(s)
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "/opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "/opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:32 user nova-compute[71689]: DEBUG nova.policy [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:33 user nova-compute[71689]: DEBUG nova.policy [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '740d636ab92c4700b480ea58ce6a30ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762a37326f89466c9ee3714ea2e2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:33 user sudo[80420]: pam_unix(sudo:session): session closed for user root
Apr 14 17:03:33 user nova-compute[71689]: INFO oslo.privsep.daemon [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Spawned new privsep daemon via rootwrap
Apr 14 17:03:33 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 17:03:33 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 17:03:33 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 17:03:33 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80425
Apr 14 17:03:33 user nova-compute[71689]: WARNING oslo_privsep.priv_context [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] privsep daemon already running
Apr 14 17:03:33 user nova-compute[71689]: WARNING oslo_privsep.priv_context [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] privsep daemon already running
Apr 14 17:03:33 user nova-compute[71689]: WARNING oslo_privsep.priv_context [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] privsep daemon already running
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.118s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.121s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.165s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.127s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk 1073741824" returned: 0 in 0.041s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.140s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.166s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk 1073741824" returned: 0 in 0.057s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.386s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Cannot resize image /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'migration_context' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Ensure instance console log exists: /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.163s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.181s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk 1073741824" returned: 0 in 0.057s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.673s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Cannot resize image /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lazy-loading 'migration_context' on Instance uuid 3ed9bc80-9e7d-4de9-ac86-704c927b111d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Ensure instance console log exists: /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:03:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Successfully created port: adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.243s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.231s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk 1073741824" returned: 0 in 0.061s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Cannot resize image /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'migration_context' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Ensure instance console log exists: /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Cannot resize image /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lazy-loading 'migration_context' on Instance uuid 6e707b44-e838-4494-9fbc-5698e755e09e {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Ensure instance console log exists: /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Successfully created port: 5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Successfully updated port: 0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquired lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-changed-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Refreshing instance network info cache due to event network-changed-0b4fc330-8a13-4916-b3be-16398b46bec1. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:03:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Acquiring lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Successfully created port: 6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updating instance_info_cache with network_info: [{"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Releasing lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Instance network_info: |[{"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Acquired lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.neutron [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Refreshing network info cache for port 0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Start _get_guest_xml network_info=[{"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:03:37 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:37 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-279445092',display_name='tempest-ServersNegativeTestJSON-server-279445092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-279445092',id=1,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426156fb00db428683851cf731b680d1',ramdisk_id='',reservation_id='r-ozwlf74f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1832599821',owner_user_name='tempest-ServersNegativeTestJSON-1832599821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:31Z,user_data=None,user_id='0d1ea0218b044c1e94f61a07c1d14a75',uuid=3ed9bc80-9e7d-4de9-ac86-704c927b111d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converting VIF {"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.objects.instance [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ed9bc80-9e7d-4de9-ac86-704c927b111d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:03:37 user nova-compute[71689]:   <uuid>3ed9bc80-9e7d-4de9-ac86-704c927b111d</uuid>
Apr 14 17:03:37 user nova-compute[71689]:   <name>instance-00000001</name>
Apr 14 17:03:37 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:03:37 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:03:37 user nova-compute[71689]:   <metadata>
Apr 14 17:03:37 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:03:37 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:03:37 user nova-compute[71689]:       <nova:name>tempest-ServersNegativeTestJSON-server-279445092</nova:name>
Apr 14 17:03:37 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:03:37</nova:creationTime>
Apr 14 17:03:37 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:03:37 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:03:37 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:03:37 user nova-compute[71689]:       <nova:owner>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:user uuid="0d1ea0218b044c1e94f61a07c1d14a75">tempest-ServersNegativeTestJSON-1832599821-project-member</nova:user>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:project uuid="426156fb00db428683851cf731b680d1">tempest-ServersNegativeTestJSON-1832599821</nova:project>
Apr 14 17:03:37 user nova-compute[71689]:       </nova:owner>
Apr 14 17:03:37 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:03:37 user nova-compute[71689]:       <nova:ports>
Apr 14 17:03:37 user nova-compute[71689]:         <nova:port uuid="0b4fc330-8a13-4916-b3be-16398b46bec1">
Apr 14 17:03:37 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:03:37 user nova-compute[71689]:         </nova:port>
Apr 14 17:03:37 user nova-compute[71689]:       </nova:ports>
Apr 14 17:03:37 user nova-compute[71689]:     </nova:instance>
Apr 14 17:03:37 user nova-compute[71689]:   </metadata>
Apr 14 17:03:37 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:03:37 user nova-compute[71689]:     <system>
Apr 14 17:03:37 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:03:37 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:03:37 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:03:37 user nova-compute[71689]:       <entry name="serial">3ed9bc80-9e7d-4de9-ac86-704c927b111d</entry>
Apr 14 17:03:37 user nova-compute[71689]:       <entry name="uuid">3ed9bc80-9e7d-4de9-ac86-704c927b111d</entry>
Apr 14 17:03:37 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:03:37 user nova-compute[71689]:     </system>
Apr 14 17:03:37 user nova-compute[71689]:   </sysinfo>
Apr 14 17:03:37 user nova-compute[71689]:   <os>
Apr 14 17:03:37 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:03:37 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:03:37 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:03:37 user nova-compute[71689]:   </os>
Apr 14 17:03:37 user nova-compute[71689]:   <features>
Apr 14 17:03:37 user nova-compute[71689]:     <acpi/>
Apr 14 17:03:37 user nova-compute[71689]:     <apic/>
Apr 14 17:03:37 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:03:37 user nova-compute[71689]:   </features>
Apr 14 17:03:37 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:03:37 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:03:37 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:03:37 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:03:37 user nova-compute[71689]:   </clock>
Apr 14 17:03:37 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:03:37 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:03:37 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:03:37 user nova-compute[71689]:   </cpu>
Apr 14 17:03:37 user nova-compute[71689]:   <devices>
Apr 14 17:03:37 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:03:37 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:03:37 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk"/>
Apr 14 17:03:37 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:03:37 user nova-compute[71689]:     </disk>
Apr 14 17:03:37 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:03:37 user nova-compute[71689]:       <mac address="fa:16:3e:da:93:bd"/>
Apr 14 17:03:37 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:37 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:03:37 user nova-compute[71689]:       <target dev="tap0b4fc330-8a"/>
Apr 14 17:03:37 user nova-compute[71689]:     </interface>
Apr 14 17:03:37 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:03:37 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/console.log" append="off"/>
Apr 14 17:03:37 user nova-compute[71689]:     </serial>
Apr 14 17:03:37 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:03:37 user nova-compute[71689]:     <video>
Apr 14 17:03:37 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:37 user nova-compute[71689]:     </video>
Apr 14 17:03:37 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:03:37 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:03:37 user nova-compute[71689]:     </rng>
Apr 14 17:03:37 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:03:37 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:03:37 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:03:37 user nova-compute[71689]:     </memballoon>
Apr 14 17:03:37 user nova-compute[71689]:   </devices>
Apr 14 17:03:37 user nova-compute[71689]: </domain>
Apr 14 17:03:37 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-279445092',display_name='tempest-ServersNegativeTestJSON-server-279445092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-279445092',id=1,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426156fb00db428683851cf731b680d1',ramdisk_id='',reservation_id='r-ozwlf74f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1832599821',owner_user_name='tempest-ServersNegativeTestJSON-1832599821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:31Z,user_data=None,user_id='0d1ea0218b044c1e94f61a07c1d14a75',uuid=3ed9bc80-9e7d-4de9-ac86-704c927b111d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converting VIF {"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:37 user nova-compute[71689]: DEBUG os_vif [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Created schema index Interface.name {{(pid=71689) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Created schema index Port.name {{(pid=71689) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Created schema index Bridge.name {{(pid=71689) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [POLLOUT] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:03:38 user nova-compute[71689]: INFO oslo.privsep.daemon [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpnw7ejypp/privsep.sock']
Apr 14 17:03:38 user sudo[80493]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpnw7ejypp/privsep.sock
Apr 14 17:03:38 user sudo[80493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 17:03:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Successfully updated port: adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquired lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-changed-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Refreshing instance network info cache due to event network-changed-adb6bafa-17f9-4c4e-af68-632cc59c3a03. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Acquiring lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Successfully updated port: 5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "refresh_cache-6e707b44-e838-4494-9fbc-5698e755e09e" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquired lock "refresh_cache-6e707b44-e838-4494-9fbc-5698e755e09e" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updated VIF entry in instance network info cache for port 0b4fc330-8a13-4916-b3be-16398b46bec1. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updating instance_info_cache with network_info: [{"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Releasing lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updating instance_info_cache with network_info: [{"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Releasing lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Instance network_info: |[{"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Acquired lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Refreshing network info cache for port adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Start _get_guest_xml network_info=[{"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:03:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-304489661',display_name='tempest-AttachVolumeNegativeTest-server-304489661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-304489661',id=2,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMFX3PNhmn48zAcAM32FCi6I37xeoBXmvNkQF9+BlyxoC3Wt0VKiGtT8+ZV4F3wVaRtE4tHpycwzfuy8U0QMx+VsAblObJ2Jwl7GhaAEZfytnLGzIAsPxYRqQiYBh5Ikg==',key_name='tempest-keypair-425177179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-9c3g4xq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=c0488788-7b88-4c48-9fcd-02640c09feb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'pci_devices' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:03:39 user nova-compute[71689]:   <uuid>c0488788-7b88-4c48-9fcd-02640c09feb1</uuid>
Apr 14 17:03:39 user nova-compute[71689]:   <name>instance-00000002</name>
Apr 14 17:03:39 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:03:39 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:03:39 user nova-compute[71689]:   <metadata>
Apr 14 17:03:39 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:03:39 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:03:39 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeNegativeTest-server-304489661</nova:name>
Apr 14 17:03:39 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:03:39</nova:creationTime>
Apr 14 17:03:39 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:03:39 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:03:39 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:03:39 user nova-compute[71689]:       <nova:owner>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:user uuid="d9c9e0d318eb4ca49d47d620682fb00a">tempest-AttachVolumeNegativeTest-1177875221-project-member</nova:user>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:project uuid="6f341a2096b9483787b569a59f325556">tempest-AttachVolumeNegativeTest-1177875221</nova:project>
Apr 14 17:03:39 user nova-compute[71689]:       </nova:owner>
Apr 14 17:03:39 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:03:39 user nova-compute[71689]:       <nova:ports>
Apr 14 17:03:39 user nova-compute[71689]:         <nova:port uuid="adb6bafa-17f9-4c4e-af68-632cc59c3a03">
Apr 14 17:03:39 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 17:03:39 user nova-compute[71689]:         </nova:port>
Apr 14 17:03:39 user nova-compute[71689]:       </nova:ports>
Apr 14 17:03:39 user nova-compute[71689]:     </nova:instance>
Apr 14 17:03:39 user nova-compute[71689]:   </metadata>
Apr 14 17:03:39 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:03:39 user nova-compute[71689]:     <system>
Apr 14 17:03:39 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:03:39 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:03:39 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:03:39 user nova-compute[71689]:       <entry name="serial">c0488788-7b88-4c48-9fcd-02640c09feb1</entry>
Apr 14 17:03:39 user nova-compute[71689]:       <entry name="uuid">c0488788-7b88-4c48-9fcd-02640c09feb1</entry>
Apr 14 17:03:39 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:03:39 user nova-compute[71689]:     </system>
Apr 14 17:03:39 user nova-compute[71689]:   </sysinfo>
Apr 14 17:03:39 user nova-compute[71689]:   <os>
Apr 14 17:03:39 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:03:39 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:03:39 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:03:39 user nova-compute[71689]:   </os>
Apr 14 17:03:39 user nova-compute[71689]:   <features>
Apr 14 17:03:39 user nova-compute[71689]:     <acpi/>
Apr 14 17:03:39 user nova-compute[71689]:     <apic/>
Apr 14 17:03:39 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:03:39 user nova-compute[71689]:   </features>
Apr 14 17:03:39 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:03:39 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:03:39 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:03:39 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:03:39 user nova-compute[71689]:   </clock>
Apr 14 17:03:39 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:03:39 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:03:39 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:03:39 user nova-compute[71689]:   </cpu>
Apr 14 17:03:39 user nova-compute[71689]:   <devices>
Apr 14 17:03:39 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:03:39 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:03:39 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk"/>
Apr 14 17:03:39 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:03:39 user nova-compute[71689]:     </disk>
Apr 14 17:03:39 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:03:39 user nova-compute[71689]:       <mac address="fa:16:3e:70:b7:23"/>
Apr 14 17:03:39 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:39 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:03:39 user nova-compute[71689]:       <target dev="tapadb6bafa-17"/>
Apr 14 17:03:39 user nova-compute[71689]:     </interface>
Apr 14 17:03:39 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:03:39 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/console.log" append="off"/>
Apr 14 17:03:39 user nova-compute[71689]:     </serial>
Apr 14 17:03:39 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:03:39 user nova-compute[71689]:     <video>
Apr 14 17:03:39 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:39 user nova-compute[71689]:     </video>
Apr 14 17:03:39 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:03:39 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:03:39 user nova-compute[71689]:     </rng>
Apr 14 17:03:39 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:03:39 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:03:39 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:03:39 user nova-compute[71689]:     </memballoon>
Apr 14 17:03:39 user nova-compute[71689]:   </devices>
Apr 14 17:03:39 user nova-compute[71689]: </domain>
Apr 14 17:03:39 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-304489661',display_name='tempest-AttachVolumeNegativeTest-server-304489661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-304489661',id=2,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMFX3PNhmn48zAcAM32FCi6I37xeoBXmvNkQF9+BlyxoC3Wt0VKiGtT8+ZV4F3wVaRtE4tHpycwzfuy8U0QMx+VsAblObJ2Jwl7GhaAEZfytnLGzIAsPxYRqQiYBh5Ikg==',key_name='tempest-keypair-425177179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-9c3g4xq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=c0488788-7b88-4c48-9fcd-02640c09feb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG os_vif [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:03:39 user sudo[80493]: pam_unix(sudo:session): session closed for user root
Apr 14 17:03:39 user nova-compute[71689]: INFO oslo.privsep.daemon [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Spawned new privsep daemon via rootwrap
Apr 14 17:03:39 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 17:03:39 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 17:03:39 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 17:03:39 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80496
Apr 14 17:03:39 user nova-compute[71689]: WARNING oslo_privsep.priv_context [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] privsep daemon already running
Apr 14 17:03:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Updating instance_info_cache with network_info: [{"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Releasing lock "refresh_cache-6e707b44-e838-4494-9fbc-5698e755e09e" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Instance network_info: |[{"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Start _get_guest_xml network_info=[{"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:03:40 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:40 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1168352709',display_name='tempest-DeleteServersTestJSON-server-1168352709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1168352709',id=4,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='762a37326f89466c9ee3714ea2e2e905',ramdisk_id='',reservation_id='r-atu8keqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1540294942',owner_user_name='tempest-DeleteServersTestJSON-1540294942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:33Z,user_data=None,user_id='740d636ab92c4700b480ea58ce6a30ff',uuid=6e707b44-e838-4494-9fbc-5698e755e09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Converting VIF {"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.objects.instance [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e707b44-e838-4494-9fbc-5698e755e09e {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:03:40 user nova-compute[71689]:   <uuid>6e707b44-e838-4494-9fbc-5698e755e09e</uuid>
Apr 14 17:03:40 user nova-compute[71689]:   <name>instance-00000004</name>
Apr 14 17:03:40 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:03:40 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:03:40 user nova-compute[71689]:   <metadata>
Apr 14 17:03:40 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:03:40 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:03:40 user nova-compute[71689]:       <nova:name>tempest-DeleteServersTestJSON-server-1168352709</nova:name>
Apr 14 17:03:40 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:03:40</nova:creationTime>
Apr 14 17:03:40 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:03:40 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:03:40 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:03:40 user nova-compute[71689]:       <nova:owner>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:user uuid="740d636ab92c4700b480ea58ce6a30ff">tempest-DeleteServersTestJSON-1540294942-project-member</nova:user>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:project uuid="762a37326f89466c9ee3714ea2e2e905">tempest-DeleteServersTestJSON-1540294942</nova:project>
Apr 14 17:03:40 user nova-compute[71689]:       </nova:owner>
Apr 14 17:03:40 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:03:40 user nova-compute[71689]:       <nova:ports>
Apr 14 17:03:40 user nova-compute[71689]:         <nova:port uuid="5572c41c-64e8-4058-9a5e-f3a994e78787">
Apr 14 17:03:40 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:03:40 user nova-compute[71689]:         </nova:port>
Apr 14 17:03:40 user nova-compute[71689]:       </nova:ports>
Apr 14 17:03:40 user nova-compute[71689]:     </nova:instance>
Apr 14 17:03:40 user nova-compute[71689]:   </metadata>
Apr 14 17:03:40 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:03:40 user nova-compute[71689]:     <system>
Apr 14 17:03:40 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:03:40 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:03:40 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:03:40 user nova-compute[71689]:       <entry name="serial">6e707b44-e838-4494-9fbc-5698e755e09e</entry>
Apr 14 17:03:40 user nova-compute[71689]:       <entry name="uuid">6e707b44-e838-4494-9fbc-5698e755e09e</entry>
Apr 14 17:03:40 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:03:40 user nova-compute[71689]:     </system>
Apr 14 17:03:40 user nova-compute[71689]:   </sysinfo>
Apr 14 17:03:40 user nova-compute[71689]:   <os>
Apr 14 17:03:40 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:03:40 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:03:40 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:03:40 user nova-compute[71689]:   </os>
Apr 14 17:03:40 user nova-compute[71689]:   <features>
Apr 14 17:03:40 user nova-compute[71689]:     <acpi/>
Apr 14 17:03:40 user nova-compute[71689]:     <apic/>
Apr 14 17:03:40 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:03:40 user nova-compute[71689]:   </features>
Apr 14 17:03:40 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:03:40 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:03:40 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:03:40 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:03:40 user nova-compute[71689]:   </clock>
Apr 14 17:03:40 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:03:40 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:03:40 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:03:40 user nova-compute[71689]:   </cpu>
Apr 14 17:03:40 user nova-compute[71689]:   <devices>
Apr 14 17:03:40 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:03:40 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:03:40 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk"/>
Apr 14 17:03:40 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:03:40 user nova-compute[71689]:     </disk>
Apr 14 17:03:40 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:03:40 user nova-compute[71689]:       <mac address="fa:16:3e:64:cc:6f"/>
Apr 14 17:03:40 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:40 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:03:40 user nova-compute[71689]:       <target dev="tap5572c41c-64"/>
Apr 14 17:03:40 user nova-compute[71689]:     </interface>
Apr 14 17:03:40 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:03:40 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/console.log" append="off"/>
Apr 14 17:03:40 user nova-compute[71689]:     </serial>
Apr 14 17:03:40 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:03:40 user nova-compute[71689]:     <video>
Apr 14 17:03:40 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:40 user nova-compute[71689]:     </video>
Apr 14 17:03:40 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:03:40 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:03:40 user nova-compute[71689]:     </rng>
Apr 14 17:03:40 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:03:40 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:03:40 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:03:40 user nova-compute[71689]:     </memballoon>
Apr 14 17:03:40 user nova-compute[71689]:   </devices>
Apr 14 17:03:40 user nova-compute[71689]: </domain>
Apr 14 17:03:40 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1168352709',display_name='tempest-DeleteServersTestJSON-server-1168352709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1168352709',id=4,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='762a37326f89466c9ee3714ea2e2e905',ramdisk_id='',reservation_id='r-atu8keqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1540294942',owner_user_name='tempest-DeleteServersTestJSON-1540294942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:33Z,user_data=None,user_id='740d636ab92c4700b480ea58ce6a30ff',uuid=6e707b44-e838-4494-9fbc-5698e755e09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Converting VIF {"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG os_vif [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b4fc330-8a, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b4fc330-8a, col_values=(('external_ids', {'iface-id': '0b4fc330-8a13-4916-b3be-16398b46bec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:93:bd', 'vm-uuid': '3ed9bc80-9e7d-4de9-ac86-704c927b111d'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: INFO os_vif [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a')
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadb6bafa-17, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadb6bafa-17, col_values=(('external_ids', {'iface-id': 'adb6bafa-17f9-4c4e-af68-632cc59c3a03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:b7:23', 'vm-uuid': 'c0488788-7b88-4c48-9fcd-02640c09feb1'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: INFO os_vif [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17')
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5572c41c-64, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5572c41c-64, col_values=(('external_ids', {'iface-id': '5572c41c-64e8-4058-9a5e-f3a994e78787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:cc:6f', 'vm-uuid': '6e707b44-e838-4494-9fbc-5698e755e09e'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:40 user nova-compute[71689]: INFO os_vif [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64')
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] No VIF found with MAC fa:16:3e:da:93:bd, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:70:b7:23, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] No VIF found with MAC fa:16:3e:64:cc:6f, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Successfully updated port: 6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-changed-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Refreshing instance network info cache due to event network-changed-5572c41c-64e8-4058-9a5e-f3a994e78787. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Acquiring lock "refresh_cache-6e707b44-e838-4494-9fbc-5698e755e09e" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Acquired lock "refresh_cache-6e707b44-e838-4494-9fbc-5698e755e09e" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Refreshing network info cache for port 5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:03:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-changed-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Refreshing instance network info cache due to event network-changed-6ed5f4a5-3c4e-48f6-8667-efda89e23575. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.network.neutron [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updated VIF entry in instance network info cache for port adb6bafa-17f9-4c4e-af68-632cc59c3a03. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.network.neutron [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updating instance_info_cache with network_info: [{"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Releasing lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:41 user nova-compute[71689]: INFO nova.compute.claims [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Claim successful on node user
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance network_info: |[{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Refreshing network info cache for port 6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start _get_guest_xml network_info=[{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:03:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'pci_devices' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:03:42 user nova-compute[71689]:   <uuid>d68b702a-a0dc-4030-9893-87b4ef44fb97</uuid>
Apr 14 17:03:42 user nova-compute[71689]:   <name>instance-00000003</name>
Apr 14 17:03:42 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:03:42 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:03:42 user nova-compute[71689]:   <metadata>
Apr 14 17:03:42 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:03:42 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:03:42 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeTestJSON-server-1946928573</nova:name>
Apr 14 17:03:42 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:03:42</nova:creationTime>
Apr 14 17:03:42 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:03:42 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:03:42 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:03:42 user nova-compute[71689]:       <nova:owner>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:user uuid="d7c4734925f645248b0f9060aa78a502">tempest-AttachVolumeTestJSON-917907278-project-member</nova:user>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:project uuid="0c8f6b39515e456c9f5a1affa9f79000">tempest-AttachVolumeTestJSON-917907278</nova:project>
Apr 14 17:03:42 user nova-compute[71689]:       </nova:owner>
Apr 14 17:03:42 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:03:42 user nova-compute[71689]:       <nova:ports>
Apr 14 17:03:42 user nova-compute[71689]:         <nova:port uuid="6ed5f4a5-3c4e-48f6-8667-efda89e23575">
Apr 14 17:03:42 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:03:42 user nova-compute[71689]:         </nova:port>
Apr 14 17:03:42 user nova-compute[71689]:       </nova:ports>
Apr 14 17:03:42 user nova-compute[71689]:     </nova:instance>
Apr 14 17:03:42 user nova-compute[71689]:   </metadata>
Apr 14 17:03:42 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:03:42 user nova-compute[71689]:     <system>
Apr 14 17:03:42 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:03:42 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:03:42 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:03:42 user nova-compute[71689]:       <entry name="serial">d68b702a-a0dc-4030-9893-87b4ef44fb97</entry>
Apr 14 17:03:42 user nova-compute[71689]:       <entry name="uuid">d68b702a-a0dc-4030-9893-87b4ef44fb97</entry>
Apr 14 17:03:42 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:03:42 user nova-compute[71689]:     </system>
Apr 14 17:03:42 user nova-compute[71689]:   </sysinfo>
Apr 14 17:03:42 user nova-compute[71689]:   <os>
Apr 14 17:03:42 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:03:42 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:03:42 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:03:42 user nova-compute[71689]:   </os>
Apr 14 17:03:42 user nova-compute[71689]:   <features>
Apr 14 17:03:42 user nova-compute[71689]:     <acpi/>
Apr 14 17:03:42 user nova-compute[71689]:     <apic/>
Apr 14 17:03:42 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:03:42 user nova-compute[71689]:   </features>
Apr 14 17:03:42 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:03:42 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:03:42 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:03:42 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:03:42 user nova-compute[71689]:   </clock>
Apr 14 17:03:42 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:03:42 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:03:42 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:03:42 user nova-compute[71689]:   </cpu>
Apr 14 17:03:42 user nova-compute[71689]:   <devices>
Apr 14 17:03:42 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:03:42 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:03:42 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk"/>
Apr 14 17:03:42 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:03:42 user nova-compute[71689]:     </disk>
Apr 14 17:03:42 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:03:42 user nova-compute[71689]:       <mac address="fa:16:3e:bf:7d:0c"/>
Apr 14 17:03:42 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:42 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:03:42 user nova-compute[71689]:       <target dev="tap6ed5f4a5-3c"/>
Apr 14 17:03:42 user nova-compute[71689]:     </interface>
Apr 14 17:03:42 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:03:42 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/console.log" append="off"/>
Apr 14 17:03:42 user nova-compute[71689]:     </serial>
Apr 14 17:03:42 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:03:42 user nova-compute[71689]:     <video>
Apr 14 17:03:42 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:42 user nova-compute[71689]:     </video>
Apr 14 17:03:42 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:03:42 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:03:42 user nova-compute[71689]:     </rng>
Apr 14 17:03:42 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:03:42 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:03:42 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:03:42 user nova-compute[71689]:     </memballoon>
Apr 14 17:03:42 user nova-compute[71689]:   </devices>
Apr 14 17:03:42 user nova-compute[71689]: </domain>
Apr 14 17:03:42 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG os_vif [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed5f4a5-3c, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ed5f4a5-3c, col_values=(('external_ids', {'iface-id': '6ed5f4a5-3c4e-48f6-8667-efda89e23575', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:7d:0c', 'vm-uuid': 'd68b702a-a0dc-4030-9893-87b4ef44fb97'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:03:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:42 user nova-compute[71689]: INFO os_vif [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c')
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No VIF found with MAC fa:16:3e:bf:7d:0c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Updated VIF entry in instance network info cache for port 5572c41c-64e8-4058-9a5e-f3a994e78787. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Updating instance_info_cache with network_info: [{"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Creating image(s)
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Releasing lock "refresh_cache-6e707b44-e838-4494-9fbc-5698e755e09e" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.policy [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.126s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.152s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk 1073741824" returned: 0 in 0.078s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Cannot resize image /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:03:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'migration_context' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Ensure instance console log exists: /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updated VIF entry in instance network info cache for port 6ed5f4a5-3c4e-48f6-8667-efda89e23575. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:44 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Successfully created port: 526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:46 user nova-compute[71689]: WARNING nova.compute.manager [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received unexpected event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with vm_state building and task_state spawning.
Apr 14 17:03:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] No waiting events found dispatching network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:46 user nova-compute[71689]: WARNING nova.compute.manager [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received unexpected event network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance with vm_state building and task_state spawning.
Apr 14 17:03:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Successfully updated port: 526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:03:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:03:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:03:47 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491827.983958, 6e707b44-e838-4494-9fbc-5698e755e09e => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] VM Resumed (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Instance spawned successfully.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance spawned successfully.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Instance spawned successfully.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Instance spawned successfully.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491827.9846063, 6e707b44-e838-4494-9fbc-5698e755e09e => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] VM Started (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Took 15.43 seconds to spawn the instance on the hypervisor.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:48 user nova-compute[71689]: WARNING nova.compute.manager [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received unexpected event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with vm_state building and task_state spawning.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing instance network info cache due to event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Took 15.86 seconds to spawn the instance on the hypervisor.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491827.9934256, c0488788-7b88-4c48-9fcd-02640c09feb1 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] VM Resumed (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Took 17.27 seconds to spawn the instance on the hypervisor.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Took 16.80 seconds to build instance.
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491828.0018332, c0488788-7b88-4c48-9fcd-02640c09feb1 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] VM Started (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Took 16.29 seconds to build instance.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.413s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] No waiting events found dispatching network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:48 user nova-compute[71689]: WARNING nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received unexpected event network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance with vm_state building and task_state spawning.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] No waiting events found dispatching network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:48 user nova-compute[71689]: WARNING nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received unexpected event network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 for instance with vm_state active and task_state None.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] No waiting events found dispatching network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:48 user nova-compute[71689]: WARNING nova.compute.manager [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received unexpected event network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 for instance with vm_state active and task_state None.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.458s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Took 16.44 seconds to spawn the instance on the hypervisor.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Took 18.36 seconds to build instance.
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491828.0019763, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Resumed (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.686s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491828.002599, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Started (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Took 17.93 seconds to build instance.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.073s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance network_info: |[{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Start _get_guest_xml network_info=[{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491828.0292675, 3ed9bc80-9e7d-4de9-ac86-704c927b111d => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] VM Resumed (Lifecycle Event)
Apr 14 17:03:48 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:48 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:03:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1113450813',display_name='tempest-ServerStableDeviceRescueTest-server-1113450813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1113450813',id=5,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzVLXKTMjj+oWgl5UjeCg470ILAsgtQRYzCsqgruNLBE9s509BMvlpfzsOb9vynIrkGPbYSSRskFS/m1TTup2eransCsvDdeWR+bzlyn30Rn6MOx9JQq0u/nbPnQu7vxQ==',key_name='tempest-keypair-1270943457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fa2764eee6c4071b5607f78762ca653',ramdisk_id='',reservation_id='r-26b4b70p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-363765322',owner_user_name='tempest-ServerStableDeviceRescueTest-363765322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d67df67ba8e4905bf7c6545c5748a41',uuid=d5920661-9030-4cf7-88a0-1ad789eec1bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converting VIF {"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'pci_devices' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:03:49 user nova-compute[71689]:   <uuid>d5920661-9030-4cf7-88a0-1ad789eec1bd</uuid>
Apr 14 17:03:49 user nova-compute[71689]:   <name>instance-00000005</name>
Apr 14 17:03:49 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:03:49 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:03:49 user nova-compute[71689]:   <metadata>
Apr 14 17:03:49 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:03:49 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:03:49 user nova-compute[71689]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1113450813</nova:name>
Apr 14 17:03:49 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:03:48</nova:creationTime>
Apr 14 17:03:49 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:03:49 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:03:49 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:03:49 user nova-compute[71689]:       <nova:owner>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:user uuid="1d67df67ba8e4905bf7c6545c5748a41">tempest-ServerStableDeviceRescueTest-363765322-project-member</nova:user>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:project uuid="7fa2764eee6c4071b5607f78762ca653">tempest-ServerStableDeviceRescueTest-363765322</nova:project>
Apr 14 17:03:49 user nova-compute[71689]:       </nova:owner>
Apr 14 17:03:49 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:03:49 user nova-compute[71689]:       <nova:ports>
Apr 14 17:03:49 user nova-compute[71689]:         <nova:port uuid="526282d7-c5ce-4ae0-9745-4e43477222f0">
Apr 14 17:03:49 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:03:49 user nova-compute[71689]:         </nova:port>
Apr 14 17:03:49 user nova-compute[71689]:       </nova:ports>
Apr 14 17:03:49 user nova-compute[71689]:     </nova:instance>
Apr 14 17:03:49 user nova-compute[71689]:   </metadata>
Apr 14 17:03:49 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:03:49 user nova-compute[71689]:     <system>
Apr 14 17:03:49 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:03:49 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:03:49 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:03:49 user nova-compute[71689]:       <entry name="serial">d5920661-9030-4cf7-88a0-1ad789eec1bd</entry>
Apr 14 17:03:49 user nova-compute[71689]:       <entry name="uuid">d5920661-9030-4cf7-88a0-1ad789eec1bd</entry>
Apr 14 17:03:49 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:03:49 user nova-compute[71689]:     </system>
Apr 14 17:03:49 user nova-compute[71689]:   </sysinfo>
Apr 14 17:03:49 user nova-compute[71689]:   <os>
Apr 14 17:03:49 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:03:49 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:03:49 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:03:49 user nova-compute[71689]:   </os>
Apr 14 17:03:49 user nova-compute[71689]:   <features>
Apr 14 17:03:49 user nova-compute[71689]:     <acpi/>
Apr 14 17:03:49 user nova-compute[71689]:     <apic/>
Apr 14 17:03:49 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:03:49 user nova-compute[71689]:   </features>
Apr 14 17:03:49 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:03:49 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:03:49 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:03:49 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:03:49 user nova-compute[71689]:   </clock>
Apr 14 17:03:49 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:03:49 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:03:49 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:03:49 user nova-compute[71689]:   </cpu>
Apr 14 17:03:49 user nova-compute[71689]:   <devices>
Apr 14 17:03:49 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:03:49 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:03:49 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk"/>
Apr 14 17:03:49 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:03:49 user nova-compute[71689]:     </disk>
Apr 14 17:03:49 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:03:49 user nova-compute[71689]:       <mac address="fa:16:3e:c3:f6:95"/>
Apr 14 17:03:49 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:49 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:03:49 user nova-compute[71689]:       <target dev="tap526282d7-c5"/>
Apr 14 17:03:49 user nova-compute[71689]:     </interface>
Apr 14 17:03:49 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:03:49 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/console.log" append="off"/>
Apr 14 17:03:49 user nova-compute[71689]:     </serial>
Apr 14 17:03:49 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:03:49 user nova-compute[71689]:     <video>
Apr 14 17:03:49 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:03:49 user nova-compute[71689]:     </video>
Apr 14 17:03:49 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:03:49 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:03:49 user nova-compute[71689]:     </rng>
Apr 14 17:03:49 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:03:49 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:03:49 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:03:49 user nova-compute[71689]:     </memballoon>
Apr 14 17:03:49 user nova-compute[71689]:   </devices>
Apr 14 17:03:49 user nova-compute[71689]: </domain>
Apr 14 17:03:49 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1113450813',display_name='tempest-ServerStableDeviceRescueTest-server-1113450813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1113450813',id=5,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzVLXKTMjj+oWgl5UjeCg470ILAsgtQRYzCsqgruNLBE9s509BMvlpfzsOb9vynIrkGPbYSSRskFS/m1TTup2eransCsvDdeWR+bzlyn30Rn6MOx9JQq0u/nbPnQu7vxQ==',key_name='tempest-keypair-1270943457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fa2764eee6c4071b5607f78762ca653',ramdisk_id='',reservation_id='r-26b4b70p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-363765322',owner_user_name='tempest-ServerStableDeviceRescueTest-363765322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d67df67ba8e4905bf7c6545c5748a41',uuid=d5920661-9030-4cf7-88a0-1ad789eec1bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converting VIF {"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG os_vif [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap526282d7-c5, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap526282d7-c5, col_values=(('external_ids', {'iface-id': '526282d7-c5ce-4ae0-9745-4e43477222f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f6:95', 'vm-uuid': 'd5920661-9030-4cf7-88a0-1ad789eec1bd'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:49 user nova-compute[71689]: INFO os_vif [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5')
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491828.0301414, 3ed9bc80-9e7d-4de9-ac86-704c927b111d => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:49 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] VM Started (Lifecycle Event)
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:03:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No VIF found with MAC fa:16:3e:c3:f6:95, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:50 user nova-compute[71689]: WARNING nova.compute.manager [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state active and task_state None.
Apr 14 17:03:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:50 user nova-compute[71689]: WARNING nova.compute.manager [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state active and task_state None.
Apr 14 17:03:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updated VIF entry in instance network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:52 user nova-compute[71689]: WARNING nova.compute.manager [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state building and task_state spawning.
Apr 14 17:03:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:53 user nova-compute[71689]: INFO nova.compute.claims [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Claim successful on node user
Apr 14 17:03:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491834.5398715, d5920661-9030-4cf7-88a0-1ad789eec1bd => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Resumed (Lifecycle Event)
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:03:54 user nova-compute[71689]: WARNING nova.compute.manager [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state building and task_state spawning.
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance spawned successfully.
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.875s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491834.5452046, d5920661-9030-4cf7-88a0-1ad789eec1bd => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Started (Lifecycle Event)
Apr 14 17:03:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Took 12.52 seconds to spawn the instance on the hypervisor.
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:03:54 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:55 user nova-compute[71689]: INFO nova.compute.manager [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Took 13.41 seconds to build instance.
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.566s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Creating image(s)
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "/opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "/opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "/opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG nova.policy [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.242s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.190s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk 1073741824" returned: 0 in 0.055s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.219s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:03:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Cannot resize image /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'migration_context' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Ensure instance console log exists: /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:03:58 user nova-compute[71689]: INFO nova.compute.claims [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Claim successful on node user
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Successfully created port: 0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:03:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:03:58 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 17:03:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG nova.policy [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd53afcd6995e4e7dbced957359802022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6431ad1110e748baaab4a94037e60782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:03:59 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Creating image(s)
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "/opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "/opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "/opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "52e23359b4e037a48b74e47bdac18b0801d5ac69" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "52e23359b4e037a48b74e47bdac18b0801d5ac69" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:03:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.part --force-share --output=json" returned: 0 in 0.243s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.virt.images [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 21bc9fa2-e92b-4bfd-92c3-eaa79b628388 was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.part /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Successfully updated port: 0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquired lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:04:00 user nova-compute[71689]: INFO nova.compute.claims [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Claim successful on node user
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-changed-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Refreshing instance network info cache due to event network-changed-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Acquiring lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.part /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.converted" returned: 0 in 0.231s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Successfully created port: 3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "52e23359b4e037a48b74e47bdac18b0801d5ac69" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.288s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "52e23359b4e037a48b74e47bdac18b0801d5ac69" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "52e23359b4e037a48b74e47bdac18b0801d5ac69" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 --force-share --output=json" returned: 0 in 0.178s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69,backing_fmt=raw /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69,backing_fmt=raw /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk 1073741824" returned: 0 in 0.074s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "52e23359b4e037a48b74e47bdac18b0801d5ac69" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updating instance_info_cache with network_info: [{"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Releasing lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Instance network_info: |[{"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Acquired lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.neutron [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Refreshing network info cache for port 0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Start _get_guest_xml network_info=[{"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 --force-share --output=json" returned: 0 in 0.303s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-883128230',display_name='tempest-VolumesAdminNegativeTest-server-883128230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-883128230',id=6,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR1CNYcMSCZc5eqIUYpiiSdLTZSUbTWdwUiOhkSwjDpbWuIjOlJMXY2cpa5eWTlS2m8+qE/dME0iLvbqEAefO3EiObUhqvYCxqX/rY9WZyKZyz8bSdRk67t79mPKSlZeQ==',key_name='tempest-keypair-1620409315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c8f41946e544d0c93cbceb3d03e50a5',ramdisk_id='',reservation_id='r-3owe8f5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2070911352',owner_user_name='tempest-VolumesAdminNegativeTest-2070911352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01d0e8ec192748edbe2576ef1c1e1cb5',uuid=add03bde-bc0e-436a-a994-e81c3f75e4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converting VIF {"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'pci_devices' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.policy [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79ebfd1410c4ffda69bc3bfaebbc25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21607283fae4bd0a679948ea8fa4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:04:01 user nova-compute[71689]:   <uuid>add03bde-bc0e-436a-a994-e81c3f75e4c4</uuid>
Apr 14 17:04:01 user nova-compute[71689]:   <name>instance-00000006</name>
Apr 14 17:04:01 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:04:01 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:04:01 user nova-compute[71689]:   <metadata>
Apr 14 17:04:01 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:04:01 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:04:01 user nova-compute[71689]:       <nova:name>tempest-VolumesAdminNegativeTest-server-883128230</nova:name>
Apr 14 17:04:01 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:04:01</nova:creationTime>
Apr 14 17:04:01 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:04:01 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:04:01 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:04:01 user nova-compute[71689]:       <nova:owner>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:user uuid="01d0e8ec192748edbe2576ef1c1e1cb5">tempest-VolumesAdminNegativeTest-2070911352-project-member</nova:user>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:project uuid="5c8f41946e544d0c93cbceb3d03e50a5">tempest-VolumesAdminNegativeTest-2070911352</nova:project>
Apr 14 17:04:01 user nova-compute[71689]:       </nova:owner>
Apr 14 17:04:01 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:04:01 user nova-compute[71689]:       <nova:ports>
Apr 14 17:04:01 user nova-compute[71689]:         <nova:port uuid="0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488">
Apr 14 17:04:01 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:04:01 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:01 user nova-compute[71689]:       </nova:ports>
Apr 14 17:04:01 user nova-compute[71689]:     </nova:instance>
Apr 14 17:04:01 user nova-compute[71689]:   </metadata>
Apr 14 17:04:01 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:04:01 user nova-compute[71689]:     <system>
Apr 14 17:04:01 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:04:01 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:04:01 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:04:01 user nova-compute[71689]:       <entry name="serial">add03bde-bc0e-436a-a994-e81c3f75e4c4</entry>
Apr 14 17:04:01 user nova-compute[71689]:       <entry name="uuid">add03bde-bc0e-436a-a994-e81c3f75e4c4</entry>
Apr 14 17:04:01 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:04:01 user nova-compute[71689]:     </system>
Apr 14 17:04:01 user nova-compute[71689]:   </sysinfo>
Apr 14 17:04:01 user nova-compute[71689]:   <os>
Apr 14 17:04:01 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:04:01 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:04:01 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:04:01 user nova-compute[71689]:   </os>
Apr 14 17:04:01 user nova-compute[71689]:   <features>
Apr 14 17:04:01 user nova-compute[71689]:     <acpi/>
Apr 14 17:04:01 user nova-compute[71689]:     <apic/>
Apr 14 17:04:01 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:04:01 user nova-compute[71689]:   </features>
Apr 14 17:04:01 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:04:01 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:04:01 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:04:01 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:04:01 user nova-compute[71689]:   </clock>
Apr 14 17:04:01 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:04:01 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:04:01 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:04:01 user nova-compute[71689]:   </cpu>
Apr 14 17:04:01 user nova-compute[71689]:   <devices>
Apr 14 17:04:01 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:04:01 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:04:01 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk"/>
Apr 14 17:04:01 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:04:01 user nova-compute[71689]:     </disk>
Apr 14 17:04:01 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:01 user nova-compute[71689]:       <mac address="fa:16:3e:a7:bb:57"/>
Apr 14 17:04:01 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:01 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:01 user nova-compute[71689]:       <target dev="tap0e8968b4-33"/>
Apr 14 17:04:01 user nova-compute[71689]:     </interface>
Apr 14 17:04:01 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:04:01 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/console.log" append="off"/>
Apr 14 17:04:01 user nova-compute[71689]:     </serial>
Apr 14 17:04:01 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:04:01 user nova-compute[71689]:     <video>
Apr 14 17:04:01 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:01 user nova-compute[71689]:     </video>
Apr 14 17:04:01 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:04:01 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:04:01 user nova-compute[71689]:     </rng>
Apr 14 17:04:01 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:04:01 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:04:01 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:04:01 user nova-compute[71689]:     </memballoon>
Apr 14 17:04:01 user nova-compute[71689]:   </devices>
Apr 14 17:04:01 user nova-compute[71689]: </domain>
Apr 14 17:04:01 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-883128230',display_name='tempest-VolumesAdminNegativeTest-server-883128230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-883128230',id=6,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR1CNYcMSCZc5eqIUYpiiSdLTZSUbTWdwUiOhkSwjDpbWuIjOlJMXY2cpa5eWTlS2m8+qE/dME0iLvbqEAefO3EiObUhqvYCxqX/rY9WZyKZyz8bSdRk67t79mPKSlZeQ==',key_name='tempest-keypair-1620409315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c8f41946e544d0c93cbceb3d03e50a5',ramdisk_id='',reservation_id='r-3owe8f5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2070911352',owner_user_name='tempest-VolumesAdminNegativeTest-2070911352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01d0e8ec192748edbe2576ef1c1e1cb5',uuid=add03bde-bc0e-436a-a994-e81c3f75e4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converting VIF {"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG os_vif [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Cannot resize image /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'migration_context' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e8968b4-33, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e8968b4-33, col_values=(('external_ids', {'iface-id': '0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:bb:57', 'vm-uuid': 'add03bde-bc0e-436a-a994-e81c3f75e4c4'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:01 user nova-compute[71689]: INFO os_vif [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33')
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Ensure instance console log exists: /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:04:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Creating image(s)
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "/opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "/opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "/opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Successfully updated port: 3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-changed-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Refreshing instance network info cache due to event network-changed-3c8c7d04-4fcc-498a-b858-122cea028627. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Acquiring lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Acquired lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.neutron [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Refreshing network info cache for port 3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No VIF found with MAC fa:16:3e:a7:bb:57, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG nova.network.neutron [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk 1073741824" returned: 0 in 0.075s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.211s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Cannot resize image /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'migration_context' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Ensure instance console log exists: /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Releasing lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquired lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Successfully created port: dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updated VIF entry in instance network info cache for port 0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updating instance_info_cache with network_info: [{"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Releasing lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Updating instance_info_cache with network_info: [{"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Releasing lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Instance network_info: |[{"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Start _get_guest_xml network_info=[{"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T17:03:47Z,direct_url=<?>,disk_format='qcow2',id=21bc9fa2-e92b-4bfd-92c3-eaa79b628388,min_disk=0,min_ram=0,name='',owner='73ebaeac7f654fe18dd7f81a0fb21d04',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T17:03:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': '21bc9fa2-e92b-4bfd-92c3-eaa79b628388'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:04:03 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:03 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T17:03:47Z,direct_url=<?>,disk_format='qcow2',id=21bc9fa2-e92b-4bfd-92c3-eaa79b628388,min_disk=0,min_ram=0,name='',owner='73ebaeac7f654fe18dd7f81a0fb21d04',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T17:03:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1187816968',display_name='tempest-AttachSCSIVolumeTestJSON-server-1187816968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1187816968',id=7,image_ref='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt3AY0twBFJ/11W/wY1p+QHYZ5ZYF1ev1xFPxqsjQhohjW4GbK0pSGxU9yjNPkGClqmdyRmx+s0HpdzC0OQNkLSSuKwBe8eYLrWtvXtdg9FZxi6K1gvFXpYZYaXxHyN4g==',key_name='tempest-keypair-1254425015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6431ad1110e748baaab4a94037e60782',ramdisk_id='',reservation_id='r-waoeldiq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1459567257',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1459567257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d53afcd6995e4e7dbced957359802022',uuid=80bd1dd9-b80e-4533-98d5-0ca798bc4be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Converting VIF {"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'pci_devices' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:04:03 user nova-compute[71689]:   <uuid>80bd1dd9-b80e-4533-98d5-0ca798bc4be9</uuid>
Apr 14 17:04:03 user nova-compute[71689]:   <name>instance-00000007</name>
Apr 14 17:04:03 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:04:03 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:04:03 user nova-compute[71689]:   <metadata>
Apr 14 17:04:03 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:04:03 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:04:03 user nova-compute[71689]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1187816968</nova:name>
Apr 14 17:04:03 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:04:03</nova:creationTime>
Apr 14 17:04:03 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:04:03 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:04:03 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:04:03 user nova-compute[71689]:       <nova:owner>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:user uuid="d53afcd6995e4e7dbced957359802022">tempest-AttachSCSIVolumeTestJSON-1459567257-project-member</nova:user>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:project uuid="6431ad1110e748baaab4a94037e60782">tempest-AttachSCSIVolumeTestJSON-1459567257</nova:project>
Apr 14 17:04:03 user nova-compute[71689]:       </nova:owner>
Apr 14 17:04:03 user nova-compute[71689]:       <nova:root type="image" uuid="21bc9fa2-e92b-4bfd-92c3-eaa79b628388"/>
Apr 14 17:04:03 user nova-compute[71689]:       <nova:ports>
Apr 14 17:04:03 user nova-compute[71689]:         <nova:port uuid="3c8c7d04-4fcc-498a-b858-122cea028627">
Apr 14 17:04:03 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 17:04:03 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:03 user nova-compute[71689]:       </nova:ports>
Apr 14 17:04:03 user nova-compute[71689]:     </nova:instance>
Apr 14 17:04:03 user nova-compute[71689]:   </metadata>
Apr 14 17:04:03 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:04:03 user nova-compute[71689]:     <system>
Apr 14 17:04:03 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:04:03 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:04:03 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:04:03 user nova-compute[71689]:       <entry name="serial">80bd1dd9-b80e-4533-98d5-0ca798bc4be9</entry>
Apr 14 17:04:03 user nova-compute[71689]:       <entry name="uuid">80bd1dd9-b80e-4533-98d5-0ca798bc4be9</entry>
Apr 14 17:04:03 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:04:03 user nova-compute[71689]:     </system>
Apr 14 17:04:03 user nova-compute[71689]:   </sysinfo>
Apr 14 17:04:03 user nova-compute[71689]:   <os>
Apr 14 17:04:03 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:04:03 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:04:03 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:04:03 user nova-compute[71689]:   </os>
Apr 14 17:04:03 user nova-compute[71689]:   <features>
Apr 14 17:04:03 user nova-compute[71689]:     <acpi/>
Apr 14 17:04:03 user nova-compute[71689]:     <apic/>
Apr 14 17:04:03 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:04:03 user nova-compute[71689]:   </features>
Apr 14 17:04:03 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:04:03 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:04:03 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:04:03 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:04:03 user nova-compute[71689]:   </clock>
Apr 14 17:04:03 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:04:03 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:04:03 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:04:03 user nova-compute[71689]:   </cpu>
Apr 14 17:04:03 user nova-compute[71689]:   <devices>
Apr 14 17:04:03 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:04:03 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:04:03 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk"/>
Apr 14 17:04:03 user nova-compute[71689]:       <target dev="sda" bus="scsi"/>
Apr 14 17:04:03 user nova-compute[71689]:       <address type="drive" controller="0" unit="0"/>
Apr 14 17:04:03 user nova-compute[71689]:     </disk>
Apr 14 17:04:03 user nova-compute[71689]:     <disk type="file" device="cdrom">
Apr 14 17:04:03 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 17:04:03 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.config"/>
Apr 14 17:04:03 user nova-compute[71689]:       <target dev="sdb" bus="scsi"/>
Apr 14 17:04:03 user nova-compute[71689]:       <address type="drive" controller="0" unit="1"/>
Apr 14 17:04:03 user nova-compute[71689]:     </disk>
Apr 14 17:04:03 user nova-compute[71689]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 17:04:03 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:03 user nova-compute[71689]:       <mac address="fa:16:3e:da:f7:47"/>
Apr 14 17:04:03 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:03 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:03 user nova-compute[71689]:       <target dev="tap3c8c7d04-4f"/>
Apr 14 17:04:03 user nova-compute[71689]:     </interface>
Apr 14 17:04:03 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:04:03 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/console.log" append="off"/>
Apr 14 17:04:03 user nova-compute[71689]:     </serial>
Apr 14 17:04:03 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:04:03 user nova-compute[71689]:     <video>
Apr 14 17:04:03 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:03 user nova-compute[71689]:     </video>
Apr 14 17:04:03 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:04:03 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:04:03 user nova-compute[71689]:     </rng>
Apr 14 17:04:03 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:04:03 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:04:03 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:04:03 user nova-compute[71689]:     </memballoon>
Apr 14 17:04:03 user nova-compute[71689]:   </devices>
Apr 14 17:04:03 user nova-compute[71689]: </domain>
Apr 14 17:04:03 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1187816968',display_name='tempest-AttachSCSIVolumeTestJSON-server-1187816968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1187816968',id=7,image_ref='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt3AY0twBFJ/11W/wY1p+QHYZ5ZYF1ev1xFPxqsjQhohjW4GbK0pSGxU9yjNPkGClqmdyRmx+s0HpdzC0OQNkLSSuKwBe8eYLrWtvXtdg9FZxi6K1gvFXpYZYaXxHyN4g==',key_name='tempest-keypair-1254425015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6431ad1110e748baaab4a94037e60782',ramdisk_id='',reservation_id='r-waoeldiq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1459567257',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1459567257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d53afcd6995e4e7dbced957359802022',uuid=80bd1dd9-b80e-4533-98d5-0ca798bc4be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Converting VIF {"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG os_vif [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c8c7d04-4f, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c8c7d04-4f, col_values=(('external_ids', {'iface-id': '3c8c7d04-4fcc-498a-b858-122cea028627', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:f7:47', 'vm-uuid': '80bd1dd9-b80e-4533-98d5-0ca798bc4be9'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:03 user nova-compute[71689]: INFO os_vif [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f')
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No BDM found with device name sda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No VIF found with MAC fa:16:3e:da:f7:47, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:04:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Using config drive
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Successfully updated port: dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquired lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-changed-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Refreshing instance network info cache due to event network-changed-dfe61768-29ed-4753-b77a-dcc14e1ce6c2. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Acquiring lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:04 user nova-compute[71689]: WARNING nova.compute.manager [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state building and task_state spawning.
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updating instance_info_cache with network_info: [{"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Releasing lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Instance network_info: |[{"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Acquired lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Refreshing network info cache for port dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Start _get_guest_xml network_info=[{"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:04:04 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Creating config drive at /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.config
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo0afsb1f {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo0afsb1f" returned: 0 in 0.061s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:04 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:04 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1182786727',display_name='tempest-TestVolumeSwap-server-1182786727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1182786727',id=8,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc6ZfHKt1uU+YGTbQLPmXILQNP6tSFg76jl8Mc8eG/MpxCs2x8HxBR+c4ZFft6r9N7HjR6vD866q3goCTmG74sv9Hr3kvUkBHdg1JMK5TKDs2H70tdLAEuBaOJNax57+w==',key_name='tempest-keypair-1178292474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e21607283fae4bd0a679948ea8fa4881',ramdisk_id='',reservation_id='r-zsopf5nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1289119351',owner_user_name='tempest-TestVolumeSwap-1289119351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79ebfd1410c4ffda69bc3bfaebbc25d',uuid=f53cfe1f-c915-4a74-8512-84a97147f1d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Converting VIF {"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.objects.instance [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'pci_devices' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:04:04 user nova-compute[71689]:   <uuid>f53cfe1f-c915-4a74-8512-84a97147f1d1</uuid>
Apr 14 17:04:04 user nova-compute[71689]:   <name>instance-00000008</name>
Apr 14 17:04:04 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:04:04 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:04:04 user nova-compute[71689]:   <metadata>
Apr 14 17:04:04 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:04:04 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:04:04 user nova-compute[71689]:       <nova:name>tempest-TestVolumeSwap-server-1182786727</nova:name>
Apr 14 17:04:04 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:04:04</nova:creationTime>
Apr 14 17:04:04 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:04:04 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:04:04 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:04:04 user nova-compute[71689]:       <nova:owner>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:user uuid="d79ebfd1410c4ffda69bc3bfaebbc25d">tempest-TestVolumeSwap-1289119351-project-member</nova:user>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:project uuid="e21607283fae4bd0a679948ea8fa4881">tempest-TestVolumeSwap-1289119351</nova:project>
Apr 14 17:04:04 user nova-compute[71689]:       </nova:owner>
Apr 14 17:04:04 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:04:04 user nova-compute[71689]:       <nova:ports>
Apr 14 17:04:04 user nova-compute[71689]:         <nova:port uuid="dfe61768-29ed-4753-b77a-dcc14e1ce6c2">
Apr 14 17:04:04 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:04:04 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:04 user nova-compute[71689]:       </nova:ports>
Apr 14 17:04:04 user nova-compute[71689]:     </nova:instance>
Apr 14 17:04:04 user nova-compute[71689]:   </metadata>
Apr 14 17:04:04 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:04:04 user nova-compute[71689]:     <system>
Apr 14 17:04:04 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:04:04 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:04:04 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:04:04 user nova-compute[71689]:       <entry name="serial">f53cfe1f-c915-4a74-8512-84a97147f1d1</entry>
Apr 14 17:04:04 user nova-compute[71689]:       <entry name="uuid">f53cfe1f-c915-4a74-8512-84a97147f1d1</entry>
Apr 14 17:04:04 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:04:04 user nova-compute[71689]:     </system>
Apr 14 17:04:04 user nova-compute[71689]:   </sysinfo>
Apr 14 17:04:04 user nova-compute[71689]:   <os>
Apr 14 17:04:04 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:04:04 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:04:04 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:04:04 user nova-compute[71689]:   </os>
Apr 14 17:04:04 user nova-compute[71689]:   <features>
Apr 14 17:04:04 user nova-compute[71689]:     <acpi/>
Apr 14 17:04:04 user nova-compute[71689]:     <apic/>
Apr 14 17:04:04 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:04:04 user nova-compute[71689]:   </features>
Apr 14 17:04:04 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:04:04 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:04:04 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:04:04 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:04:04 user nova-compute[71689]:   </clock>
Apr 14 17:04:04 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:04:04 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:04:04 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:04:04 user nova-compute[71689]:   </cpu>
Apr 14 17:04:04 user nova-compute[71689]:   <devices>
Apr 14 17:04:04 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:04:04 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:04:04 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk"/>
Apr 14 17:04:04 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:04:04 user nova-compute[71689]:     </disk>
Apr 14 17:04:04 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:04 user nova-compute[71689]:       <mac address="fa:16:3e:3e:a5:f6"/>
Apr 14 17:04:04 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:04 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:04 user nova-compute[71689]:       <target dev="tapdfe61768-29"/>
Apr 14 17:04:04 user nova-compute[71689]:     </interface>
Apr 14 17:04:04 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:04:04 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/console.log" append="off"/>
Apr 14 17:04:04 user nova-compute[71689]:     </serial>
Apr 14 17:04:04 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:04:04 user nova-compute[71689]:     <video>
Apr 14 17:04:04 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:04 user nova-compute[71689]:     </video>
Apr 14 17:04:04 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:04:04 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:04:04 user nova-compute[71689]:     </rng>
Apr 14 17:04:04 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:04:04 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:04:04 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:04:04 user nova-compute[71689]:     </memballoon>
Apr 14 17:04:04 user nova-compute[71689]:   </devices>
Apr 14 17:04:04 user nova-compute[71689]: </domain>
Apr 14 17:04:04 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1182786727',display_name='tempest-TestVolumeSwap-server-1182786727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1182786727',id=8,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc6ZfHKt1uU+YGTbQLPmXILQNP6tSFg76jl8Mc8eG/MpxCs2x8HxBR+c4ZFft6r9N7HjR6vD866q3goCTmG74sv9Hr3kvUkBHdg1JMK5TKDs2H70tdLAEuBaOJNax57+w==',key_name='tempest-keypair-1178292474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e21607283fae4bd0a679948ea8fa4881',ramdisk_id='',reservation_id='r-zsopf5nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1289119351',owner_user_name='tempest-TestVolumeSwap-1289119351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79ebfd1410c4ffda69bc3bfaebbc25d',uuid=f53cfe1f-c915-4a74-8512-84a97147f1d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Converting VIF {"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG os_vif [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfe61768-29, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfe61768-29, col_values=(('external_ids', {'iface-id': 'dfe61768-29ed-4753-b77a-dcc14e1ce6c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:a5:f6', 'vm-uuid': 'f53cfe1f-c915-4a74-8512-84a97147f1d1'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:04 user nova-compute[71689]: INFO os_vif [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29')
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] No VIF found with MAC fa:16:3e:3e:a5:f6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.compute.claims [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Claim successful on node user
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updated VIF entry in instance network info cache for port dfe61768-29ed-4753-b77a-dcc14e1ce6c2. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updating instance_info_cache with network_info: [{"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Releasing lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491845.810296, add03bde-bc0e-436a-a994-e81c3f75e4c4 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] VM Resumed (Lifecycle Event)
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Instance spawned successfully.
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491845.8105142, add03bde-bc0e-436a-a994-e81c3f75e4c4 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] VM Started (Lifecycle Event)
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:05 user nova-compute[71689]: INFO nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Took 10.86 seconds to spawn the instance on the hypervisor.
Apr 14 17:04:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:06 user nova-compute[71689]: INFO nova.compute.manager [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Took 12.41 seconds to build instance.
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.policy [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.581s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:06 user nova-compute[71689]: WARNING nova.compute.manager [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state active and task_state None.
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:04:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Creating image(s)
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.165s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk 1073741824" returned: 0 in 0.063s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Cannot resize image /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.objects.instance [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'migration_context' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Ensure instance console log exists: /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:06 user nova-compute[71689]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Successfully created port: 34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] No waiting events found dispatching network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:07 user nova-compute[71689]: WARNING nova.compute.manager [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received unexpected event network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance with vm_state building and task_state spawning.
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Successfully updated port: 34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquired lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-changed-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Refreshing instance network info cache due to event network-changed-34ea1bd9-f010-4073-bf8d-351b0e85ceeb. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Acquiring lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] No waiting events found dispatching network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:08 user nova-compute[71689]: WARNING nova.compute.manager [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received unexpected event network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 for instance with vm_state building and task_state spawning.
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] No waiting events found dispatching network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:08 user nova-compute[71689]: WARNING nova.compute.manager [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received unexpected event network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 for instance with vm_state building and task_state spawning.
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Releasing lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Instance network_info: |[{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Acquired lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.network.neutron [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Refreshing network info cache for port 34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Start _get_guest_xml network_info=[{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:04:08 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:08 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.objects.instance [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'pci_devices' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:04:08 user nova-compute[71689]:   <uuid>113dda5c-a61e-423b-86ea-2fe30a113173</uuid>
Apr 14 17:04:08 user nova-compute[71689]:   <name>instance-00000009</name>
Apr 14 17:04:08 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:04:08 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:04:08 user nova-compute[71689]:   <metadata>
Apr 14 17:04:08 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:04:08 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:04:08 user nova-compute[71689]:       <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:04:08 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:04:08</nova:creationTime>
Apr 14 17:04:08 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:04:08 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:04:08 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:04:08 user nova-compute[71689]:       <nova:owner>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:04:08 user nova-compute[71689]:       </nova:owner>
Apr 14 17:04:08 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:04:08 user nova-compute[71689]:       <nova:ports>
Apr 14 17:04:08 user nova-compute[71689]:         <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:04:08 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:04:08 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:08 user nova-compute[71689]:       </nova:ports>
Apr 14 17:04:08 user nova-compute[71689]:     </nova:instance>
Apr 14 17:04:08 user nova-compute[71689]:   </metadata>
Apr 14 17:04:08 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:04:08 user nova-compute[71689]:     <system>
Apr 14 17:04:08 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:04:08 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:04:08 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:04:08 user nova-compute[71689]:       <entry name="serial">113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:04:08 user nova-compute[71689]:       <entry name="uuid">113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:04:08 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:04:08 user nova-compute[71689]:     </system>
Apr 14 17:04:08 user nova-compute[71689]:   </sysinfo>
Apr 14 17:04:08 user nova-compute[71689]:   <os>
Apr 14 17:04:08 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:04:08 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:04:08 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:04:08 user nova-compute[71689]:   </os>
Apr 14 17:04:08 user nova-compute[71689]:   <features>
Apr 14 17:04:08 user nova-compute[71689]:     <acpi/>
Apr 14 17:04:08 user nova-compute[71689]:     <apic/>
Apr 14 17:04:08 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:04:08 user nova-compute[71689]:   </features>
Apr 14 17:04:08 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:04:08 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:04:08 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:04:08 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:04:08 user nova-compute[71689]:   </clock>
Apr 14 17:04:08 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:04:08 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:04:08 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:04:08 user nova-compute[71689]:   </cpu>
Apr 14 17:04:08 user nova-compute[71689]:   <devices>
Apr 14 17:04:08 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:04:08 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:04:08 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk"/>
Apr 14 17:04:08 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:04:08 user nova-compute[71689]:     </disk>
Apr 14 17:04:08 user nova-compute[71689]:     <disk type="file" device="cdrom">
Apr 14 17:04:08 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 17:04:08 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config"/>
Apr 14 17:04:08 user nova-compute[71689]:       <target dev="hda" bus="ide"/>
Apr 14 17:04:08 user nova-compute[71689]:     </disk>
Apr 14 17:04:08 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:08 user nova-compute[71689]:       <mac address="fa:16:3e:37:3a:79"/>
Apr 14 17:04:08 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:08 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:08 user nova-compute[71689]:       <target dev="tap34ea1bd9-f0"/>
Apr 14 17:04:08 user nova-compute[71689]:     </interface>
Apr 14 17:04:08 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:04:08 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log" append="off"/>
Apr 14 17:04:08 user nova-compute[71689]:     </serial>
Apr 14 17:04:08 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:04:08 user nova-compute[71689]:     <video>
Apr 14 17:04:08 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:08 user nova-compute[71689]:     </video>
Apr 14 17:04:08 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:04:08 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:04:08 user nova-compute[71689]:     </rng>
Apr 14 17:04:08 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:04:08 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:04:08 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:04:08 user nova-compute[71689]:     </memballoon>
Apr 14 17:04:08 user nova-compute[71689]:   </devices>
Apr 14 17:04:08 user nova-compute[71689]: </domain>
Apr 14 17:04:08 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG os_vif [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34ea1bd9-f0, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34ea1bd9-f0, col_values=(('external_ids', {'iface-id': '34ea1bd9-f010-4073-bf8d-351b0e85ceeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:3a:79', 'vm-uuid': '113dda5c-a61e-423b-86ea-2fe30a113173'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: INFO os_vif [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0')
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No BDM found with device name hda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No VIF found with MAC fa:16:3e:37:3a:79, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:04:08 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Using config drive
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:08 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Creating config drive at /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu75eco6t {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu75eco6t" returned: 0 in 0.054s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG nova.network.neutron [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updated VIF entry in instance network info cache for port 34ea1bd9-f010-4073-bf8d-351b0e85ceeb. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG nova.network.neutron [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Releasing lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG nova.compute.manager [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:09 user nova-compute[71689]: DEBUG nova.compute.manager [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] No waiting events found dispatching network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:09 user nova-compute[71689]: WARNING nova.compute.manager [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received unexpected event network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance with vm_state building and task_state spawning.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491850.3431683, f53cfe1f-c915-4a74-8512-84a97147f1d1 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] VM Resumed (Lifecycle Event)
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Instance spawned successfully.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491850.3469615, f53cfe1f-c915-4a74-8512-84a97147f1d1 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] VM Started (Lifecycle Event)
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Instance spawned successfully.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491850.3956149, 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] VM Resumed (Lifecycle Event)
Apr 14 17:04:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Took 9.09 seconds to spawn the instance on the hypervisor.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Took 11.40 seconds to spawn the instance on the hypervisor.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491850.4036613, 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] VM Started (Lifecycle Event)
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Took 10.61 seconds to build instance.
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:10 user nova-compute[71689]: INFO nova.compute.manager [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Took 12.71 seconds to build instance.
Apr 14 17:04:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.860s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.856s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:10 user nova-compute[71689]: WARNING nova.compute.manager [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance with vm_state building and task_state spawning.
Apr 14 17:04:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:04:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:04:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:04:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491853.1969507, 113dda5c-a61e-423b-86ea-2fe30a113173 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] VM Resumed (Lifecycle Event)
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:13 user nova-compute[71689]: WARNING nova.compute.manager [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance with vm_state building and task_state spawning.
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Instance spawned successfully.
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491853.1981206, 113dda5c-a61e-423b-86ea-2fe30a113173 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] VM Started (Lifecycle Event)
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Took 7.36 seconds to spawn the instance on the hypervisor.
Apr 14 17:04:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:04:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:13 user nova-compute[71689]: INFO nova.compute.manager [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Took 8.67 seconds to build instance.
Apr 14 17:04:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.797s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:19 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:19 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7776MB free_disk=26.67176055908203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c0488788-7b88-4c48-9fcd-02640c09feb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6e707b44-e838-4494-9fbc-5698e755e09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 113dda5c-a61e-423b-86ea-2fe30a113173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:04:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:04:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:04:20 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:04:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:04:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.889s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:04:21 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 3ed9bc80-9e7d-4de9-ac86-704c927b111d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updating instance_info_cache with network_info: [{"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:04:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:04:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:04:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:31 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:04:31 user nova-compute[71689]: INFO nova.compute.claims [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Claim successful on node user
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:04:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:04:32 user nova-compute[71689]: INFO nova.virt.block_device [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Booting with volume d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 at /dev/vda
Apr 14 17:04:32 user nova-compute[71689]: DEBUG nova.policy [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:04:32 user nova-compute[71689]: DEBUG os_brick.utils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:04:32 user nova-compute[71689]: INFO oslo.privsep.daemon [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmy7cqkh9/privsep.sock']
Apr 14 17:04:32 user sudo[81985]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmy7cqkh9/privsep.sock
Apr 14 17:04:32 user sudo[81985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 17:04:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully created port: 908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully created port: 3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:34 user sudo[81985]: pam_unix(sudo:session): session closed for user root
Apr 14 17:04:34 user nova-compute[71689]: INFO oslo.privsep.daemon [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Spawned new privsep daemon via rootwrap
Apr 14 17:04:34 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 17:04:34 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 17:04:34 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 17:04:34 user nova-compute[71689]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81988
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541ced7-0213-4621-9e94-28063c29dd8e]: (2,) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7ecf9b-e9fb-412f-9e5f-835ec588b143]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:34 user nova-compute[71689]: WARNING os_brick.initiator.connectors.nvmeof [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ef0d9-1110-402b-b70e-aa3c47bee58b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ea119-51d0-4e81-8d22-2abd678c0568]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2f616-261f-4930-9c55-6e3dcef3d765]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:04:34 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:04:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5fe8a-2c6e-4807-ae13-bb3bae916fb6]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG os_brick.utils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== get_connector_properties: return (1960ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating existing volume attachment record: d780442b-654b-44c3-9a08-ee02e3d56540 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:04:34 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully created port: c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully created port: b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:36 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully created port: da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: 908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-908df516-5b0a-42b8-82d4-1f36c0dbcdc0. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.network.neutron [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port 908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.network.neutron [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.network.neutron [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:39 user nova-compute[71689]: INFO nova.virt.block_device [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Booting with volume ff4fadca-3048-4c38-9134-4fc24981f87c at /dev/vdb
Apr 14 17:04:39 user nova-compute[71689]: DEBUG os_brick.utils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:04:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37cabc-a4c8-464d-8852-4bde0e2e4bfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b2ec9-9d0e-4dbc-9392-897ef6b9441c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f520827-9d0d-4edc-9fd8-08dffa918144]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a364413-d8d8-4b6e-a1ee-50198512aea3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:04:40 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[763db475-e4d8-441b-b96e-6c81b0392e99]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG os_brick.utils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating existing volume attachment record: 81c9b341-a776-4698-930f-15bb016e67cb {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-d61ec716-2b00-4426-b014-fb1d07515463. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: 3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-f7320798-2ab9-411c-98dd-2f0006b0c3e2. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-3b216986-dcbd-4502-8655-92a598ad85db. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port 3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-c33eac6d-3cd4-491c-b151-abeb733a0a09. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Successfully updated port: da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-b14ce4b0-a632-4f21-b582-8aef000caf49. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:43 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:04:43 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:04:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:04:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:04:45 user nova-compute[71689]: INFO nova.virt.block_device [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Booting with volume f0558a5b-2574-42f0-9f57-af61d85365f7 at /dev/vdc
Apr 14 17:04:45 user nova-compute[71689]: DEBUG os_brick.utils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee17764-25bf-4cdf-84c2-4b747331c8d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[25170c42-5d6c-4cb5-9763-56ad02cfce7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[935af951-6072-47d5-8495-9d592299a978]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[355368d1-fbcc-4d45-aeb7-5bd0d67acc0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:04:45 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db65c9a-8551-41f2-a332-f470cfd614bd]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG os_brick.utils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating existing volume attachment record: 84b4db66-2503-4d43-9dab-c50ee8c3b408 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [{"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance network_info: |[{"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:04:45 user nova-compute[71689]: DEBUG nova.network.neutron [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:04:46 user nova-compute[71689]: DEBUG nova.network.neutron [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updated VIF entry in instance network info cache for port da304e0f-68cc-40fd-a4f9-1175ce2c3ad3. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:04:46 user nova-compute[71689]: DEBUG nova.network.neutron [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [{"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:04:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:04:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:04:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Creating image(s)
Apr 14 17:04:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Ensure instance console log exists: /opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Start _get_guest_xml network_info=[{"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgvWCKaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8483240-2bf3-42cd-bf10-5d8231303e58', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8a2163e-cfca-4043-8f58-3bd6fb74c8f2', 'serial': 'd8a2163e-cfca-4043-8f58-3bd6fb74c8f2'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd780442b-654b-44c3-9a08-ee02e3d56540', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBCtpGTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8483240-2bf3-42cd-bf10-5d8231303e58', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4fadca-3048-4c38-9134-4fc24981f87c', 'serial': 'ff4fadca-3048-4c38-9134-4fc24981f87c'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '81c9b341-a776-4698-930f-15bb016e67cb', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPGydwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8483240-2bf3-42cd-bf10-5d8231303e58', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0558a5b-2574-42f0-9f57-af61d85365f7', 'serial': 'f0558a5b-2574-42f0-9f57-af61d85365f7'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '84b4db66-2503-4d43-9dab-c50ee8c3b408', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:04:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connector [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Factory for ISCSI on None {{(pid=71689) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgvWCKaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:04:50 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:04:50 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:04:50 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebffed-e295-47da-9a99-86ef2c1098bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:04:50 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684b43a-3249-481e-a2de-e8ea33ae91cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2] added
Apr 14 17:04:50 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[50200738-7b13-4a8b-bacd-d02cb28c2526]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d184d2-bcd8-430a-ae53-c8d4e5d9afbf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgvWCKaZ {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgvWCKaZ" returned: 0 in 0.123s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307b26c-0c8c-496a-9509-f8b5aa2f97ac]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgvWCKaZ'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33eb84-70db-44ae-9cf2-858d7e43876c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f885a42-6459-4c87-a096-f8ccc63b7f3f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:04:50 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:04:50 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:04:50 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:04:50 user nova-compute[71689]: 
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc65fc8-f93c-42d8-abc1-0adf97c28ca7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260]
Apr 14 17:04:50 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260] successful.
Apr 14 17:04:50 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4019495-2312-45a7-b8a1-70ea014dc20f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ee1891-1d7b-4b1a-b7bf-a0b34a68074b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:50 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:50 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba7728-3264-4da5-9504-aaea3dd28542]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:04:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgvWCKaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26262666664303030', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262666664303030', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBCtpGTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:04:51 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:04:51 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:04:51 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7cee49-95cd-45db-8c3f-3f6c91b38524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:04:51 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22c297a-7535-42ef-914e-f854bb46aeb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c] added
Apr 14 17:04:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfc1ae9-27a1-4635-900d-338c423774fb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208442a-770f-478a-b562-30b9972f05a0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBCtpGTY {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBCtpGTY" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01f9a7e-f289-42e5-a348-c13d727e635c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBCtpGTY'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12ae39a-baf4-40ae-bb31-3c2d8f910c3d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cfcf81-33f8-43c7-9f3a-05de571ff7e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b6492-0a1d-470f-804b-45acd5934c07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260]
Apr 14 17:04:51 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260] successful.
Apr 14 17:04:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e29b3-3ccd-4fca-a1fc-ba44f4ec1851]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4c709e-1df2-423b-aa42-ca0fe8a8ee83]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:51 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:04:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:51 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:04:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[633665c4-9a67-412a-b715-940fee258543]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:04:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBCtpGTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26337313538333031', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337313538333031', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPGydwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:04:52 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:04:52 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:04:52 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[766caac8-2e99-4139-bb4a-91fe1ab600e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:04:52 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a98f35-399b-4450-81b1-771c5e12ef75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7] added
Apr 14 17:04:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9853e7-e36d-4618-96ac-80f657a1e5c6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[75001660-331f-4bb0-8e27-2a55957b11ae]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPGydwBV {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPGydwBV" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fcc220-08cb-4276-bda0-234af9eec3de]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPGydwBV'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[930043a0-7e0d-4c3a-bb03-b5606b436197]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a804b8-6b31-4a65-9014-edb9ba661abc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:52 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:04:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:52 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:04:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:04:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4c3245-c915-423c-ac3a-f1c1cd1f79bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260]
Apr 14 17:04:53 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260] successful.
Apr 14 17:04:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf8710c-c0b6-4dd8-8066-798adf8b7fe6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70071e7-f5c3-4df0-a8de-fcd842259e3a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:53 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:04:53 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:04:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:04:53 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:04:53 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:04:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9416fa0-6856-40c2-ad29-22ba5641db4c]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPGydwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:04:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23037383635393233', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037383635393233', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.objects.instance [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lazy-loading 'pci_devices' on Instance uuid d8483240-2bf3-42cd-bf10-5d8231303e58 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:04:54 user nova-compute[71689]:   <uuid>d8483240-2bf3-42cd-bf10-5d8231303e58</uuid>
Apr 14 17:04:54 user nova-compute[71689]:   <name>instance-0000000a</name>
Apr 14 17:04:54 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:04:54 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:04:54 user nova-compute[71689]:   <metadata>
Apr 14 17:04:54 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:04:54 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:04:54 user nova-compute[71689]:       <nova:name>tempest-device-tagging-server-12887603</nova:name>
Apr 14 17:04:54 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:04:50</nova:creationTime>
Apr 14 17:04:54 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:04:54 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:04:54 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:04:54 user nova-compute[71689]:       <nova:owner>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:user uuid="029c39b7ada54f7b9cb106f054ec8a0c">tempest-TaggedBootDevicesTest-293729122-project-member</nova:user>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:project uuid="0706fb42134445cf914a9a00b1042c01">tempest-TaggedBootDevicesTest-293729122</nova:project>
Apr 14 17:04:54 user nova-compute[71689]:       </nova:owner>
Apr 14 17:04:54 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:04:54 user nova-compute[71689]:       <nova:ports>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="908df516-5b0a-42b8-82d4-1f36c0dbcdc0">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="d61ec716-2b00-4426-b014-fb1d07515463">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="f7320798-2ab9-411c-98dd-2f0006b0c3e2">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="3b216986-dcbd-4502-8655-92a598ad85db">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="c33eac6d-3cd4-491c-b151-abeb733a0a09">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="b14ce4b0-a632-4f21-b582-8aef000caf49">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:         <nova:port uuid="da304e0f-68cc-40fd-a4f9-1175ce2c3ad3">
Apr 14 17:04:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 17:04:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:04:54 user nova-compute[71689]:       </nova:ports>
Apr 14 17:04:54 user nova-compute[71689]:     </nova:instance>
Apr 14 17:04:54 user nova-compute[71689]:   </metadata>
Apr 14 17:04:54 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:04:54 user nova-compute[71689]:     <system>
Apr 14 17:04:54 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:04:54 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:04:54 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:04:54 user nova-compute[71689]:       <entry name="serial">d8483240-2bf3-42cd-bf10-5d8231303e58</entry>
Apr 14 17:04:54 user nova-compute[71689]:       <entry name="uuid">d8483240-2bf3-42cd-bf10-5d8231303e58</entry>
Apr 14 17:04:54 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:04:54 user nova-compute[71689]:     </system>
Apr 14 17:04:54 user nova-compute[71689]:   </sysinfo>
Apr 14 17:04:54 user nova-compute[71689]:   <os>
Apr 14 17:04:54 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:04:54 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:04:54 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:04:54 user nova-compute[71689]:   </os>
Apr 14 17:04:54 user nova-compute[71689]:   <features>
Apr 14 17:04:54 user nova-compute[71689]:     <acpi/>
Apr 14 17:04:54 user nova-compute[71689]:     <apic/>
Apr 14 17:04:54 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:04:54 user nova-compute[71689]:   </features>
Apr 14 17:04:54 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:04:54 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:04:54 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:04:54 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:04:54 user nova-compute[71689]:   </clock>
Apr 14 17:04:54 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:04:54 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:04:54 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:04:54 user nova-compute[71689]:   </cpu>
Apr 14 17:04:54 user nova-compute[71689]:   <devices>
Apr 14 17:04:54 user nova-compute[71689]:     <disk type="file" device="cdrom">
Apr 14 17:04:54 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 17:04:54 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58/disk.config"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="hda" bus="ide"/>
Apr 14 17:04:54 user nova-compute[71689]:     </disk>
Apr 14 17:04:54 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:04:54 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:04:54 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <serial>d8a2163e-cfca-4043-8f58-3bd6fb74c8f2</serial>
Apr 14 17:04:54 user nova-compute[71689]:     </disk>
Apr 14 17:04:54 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:04:54 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:04:54 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <serial>ff4fadca-3048-4c38-9134-4fc24981f87c</serial>
Apr 14 17:04:54 user nova-compute[71689]:     </disk>
Apr 14 17:04:54 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:04:54 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:04:54 user nova-compute[71689]:       <source dev="/dev/sdd"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="vdc" bus="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <serial>f0558a5b-2574-42f0-9f57-af61d85365f7</serial>
Apr 14 17:04:54 user nova-compute[71689]:     </disk>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:3b:96:74"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tap908df516-5b"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:fe:9a:9a"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tapd61ec716-2b"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:cb:4f:ad"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tapf7320798-2a"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:ce:81:1a"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tap3b216986-dc"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:aa:71:b3"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tapc33eac6d-3c"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:17:1e:b7"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tapb14ce4b0-a6"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:04:54 user nova-compute[71689]:       <mac address="fa:16:3e:22:fb:cb"/>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:04:54 user nova-compute[71689]:       <target dev="tapda304e0f-68"/>
Apr 14 17:04:54 user nova-compute[71689]:     </interface>
Apr 14 17:04:54 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:04:54 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58/console.log" append="off"/>
Apr 14 17:04:54 user nova-compute[71689]:     </serial>
Apr 14 17:04:54 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:04:54 user nova-compute[71689]:     <video>
Apr 14 17:04:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:04:54 user nova-compute[71689]:     </video>
Apr 14 17:04:54 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:04:54 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:04:54 user nova-compute[71689]:     </rng>
Apr 14 17:04:54 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:04:54 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:04:54 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:04:54 user nova-compute[71689]:     </memballoon>
Apr 14 17:04:54 user nova-compute[71689]:   </devices>
Apr 14 17:04:54 user nova-compute[71689]: </domain>
Apr 14 17:04:54 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908df516-5b, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap908df516-5b, col_values=(('external_ids', {'iface-id': '908df516-5b0a-42b8-82d4-1f36c0dbcdc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:96:74', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd61ec716-2b, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd61ec716-2b, col_values=(('external_ids', {'iface-id': 'd61ec716-2b00-4426-b014-fb1d07515463', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:9a:9a', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7320798-2a, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7320798-2a, col_values=(('external_ids', {'iface-id': 'f7320798-2ab9-411c-98dd-2f0006b0c3e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:4f:ad', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b216986-dc, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b216986-dc, col_values=(('external_ids', {'iface-id': '3b216986-dcbd-4502-8655-92a598ad85db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:81:1a', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc33eac6d-3c, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc33eac6d-3c, col_values=(('external_ids', {'iface-id': 'c33eac6d-3cd4-491c-b151-abeb733a0a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:71:b3', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14ce4b0-a6, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb14ce4b0-a6, col_values=(('external_ids', {'iface-id': 'b14ce4b0-a632-4f21-b582-8aef000caf49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:1e:b7', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda304e0f-68, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda304e0f-68, col_values=(('external_ids', {'iface-id': 'da304e0f-68cc-40fd-a4f9-1175ce2c3ad3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:fb:cb', 'vm-uuid': 'd8483240-2bf3-42cd-bf10-5d8231303e58'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:54 user nova-compute[71689]: INFO os_vif [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68')
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] No BDM found with device name hda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] No VIF found with MAC fa:16:3e:3b:96:74, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] No VIF found with MAC fa:16:3e:aa:71:b3, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:04:54 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Using config drive
Apr 14 17:04:54 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Creating config drive at /opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58/disk.config
Apr 14 17:04:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc8t_gwxq {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:04:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc8t_gwxq" returned: 0 in 0.058s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:56 user nova-compute[71689]: WARNING nova.compute.manager [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance with vm_state building and task_state spawning.
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:57 user nova-compute[71689]: WARNING nova.compute.manager [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance with vm_state building and task_state spawning.
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance with vm_state building and task_state spawning.
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:58 user nova-compute[71689]: WARNING nova.compute.manager [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance with vm_state building and task_state spawning.
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:59 user nova-compute[71689]: WARNING nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance with vm_state building and task_state spawning.
Apr 14 17:04:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:59 user nova-compute[71689]: WARNING nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 for instance with vm_state building and task_state spawning.
Apr 14 17:04:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:04:59 user nova-compute[71689]: WARNING nova.compute.manager [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 for instance with vm_state building and task_state spawning.
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:04:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491900.2842891, d8483240-2bf3-42cd-bf10-5d8231303e58 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] VM Resumed (Lifecycle Event)
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance spawned successfully.
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491900.286397, d8483240-2bf3-42cd-bf10-5d8231303e58 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] VM Started (Lifecycle Event)
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Took 10.45 seconds to spawn the instance on the hypervisor.
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:00 user nova-compute[71689]: INFO nova.compute.manager [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Took 28.55 seconds to build instance.
Apr 14 17:05:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.659s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:00 user nova-compute[71689]: WARNING nova.compute.manager [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance with vm_state active and task_state None.
Apr 14 17:05:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:18 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:05:18 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7461MB free_disk=26.587684631347656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c0488788-7b88-4c48-9fcd-02640c09feb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6e707b44-e838-4494-9fbc-5698e755e09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 113dda5c-a61e-423b-86ea-2fe30a113173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d8483240-2bf3-42cd-bf10-5d8231303e58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:05:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updating instance_info_cache with network_info: [{"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7465a41f-c916-4cca-8084-7c646409007d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:05:20 user nova-compute[71689]: INFO nova.compute.claims [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Claim successful on node user
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:05:21 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.policy [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:05:21 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Creating image(s)
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "/opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "/opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "/opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk 1073741824" returned: 0 in 0.049s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:05:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Cannot resize image /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.objects.instance [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lazy-loading 'migration_context' on Instance uuid 7465a41f-c916-4cca-8084-7c646409007d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Ensure instance console log exists: /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Successfully created port: 94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-changed-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Refreshing instance network info cache due to event network-changed-6ed5f4a5-3c4e-48f6-8667-efda89e23575. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:22 user nova-compute[71689]: DEBUG nova.network.neutron [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Refreshing network info cache for port 6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Successfully updated port: 94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "refresh_cache-7465a41f-c916-4cca-8084-7c646409007d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquired lock "refresh_cache-7465a41f-c916-4cca-8084-7c646409007d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-changed-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Refreshing instance network info cache due to event network-changed-94c17c3d-5fae-4403-bc19-875a6a0ff264. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Acquiring lock "refresh_cache-7465a41f-c916-4cca-8084-7c646409007d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Updating instance_info_cache with network_info: [{"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Releasing lock "refresh_cache-7465a41f-c916-4cca-8084-7c646409007d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Instance network_info: |[{"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Acquired lock "refresh_cache-7465a41f-c916-4cca-8084-7c646409007d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Refreshing network info cache for port 94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Start _get_guest_xml network_info=[{"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:05:23 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:05:23 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-373292303',display_name='tempest-ServersNegativeTestJSON-server-373292303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-373292303',id=11,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426156fb00db428683851cf731b680d1',ramdisk_id='',reservation_id='r-osz49w3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1832599821',owner_user_name='tempest-ServersNegativeTestJSON-1832599821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:05:21Z,user_data=None,user_id='0d1ea0218b044c1e94f61a07c1d14a75',uuid=7465a41f-c916-4cca-8084-7c646409007d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converting VIF {"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.objects.instance [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lazy-loading 'pci_devices' on Instance uuid 7465a41f-c916-4cca-8084-7c646409007d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:05:23 user nova-compute[71689]:   <uuid>7465a41f-c916-4cca-8084-7c646409007d</uuid>
Apr 14 17:05:23 user nova-compute[71689]:   <name>instance-0000000b</name>
Apr 14 17:05:23 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:05:23 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:05:23 user nova-compute[71689]:   <metadata>
Apr 14 17:05:23 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:05:23 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:05:23 user nova-compute[71689]:       <nova:name>tempest-ServersNegativeTestJSON-server-373292303</nova:name>
Apr 14 17:05:23 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:05:23</nova:creationTime>
Apr 14 17:05:23 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:05:23 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:05:23 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:05:23 user nova-compute[71689]:       <nova:owner>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:user uuid="0d1ea0218b044c1e94f61a07c1d14a75">tempest-ServersNegativeTestJSON-1832599821-project-member</nova:user>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:project uuid="426156fb00db428683851cf731b680d1">tempest-ServersNegativeTestJSON-1832599821</nova:project>
Apr 14 17:05:23 user nova-compute[71689]:       </nova:owner>
Apr 14 17:05:23 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:05:23 user nova-compute[71689]:       <nova:ports>
Apr 14 17:05:23 user nova-compute[71689]:         <nova:port uuid="94c17c3d-5fae-4403-bc19-875a6a0ff264">
Apr 14 17:05:23 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 17:05:23 user nova-compute[71689]:         </nova:port>
Apr 14 17:05:23 user nova-compute[71689]:       </nova:ports>
Apr 14 17:05:23 user nova-compute[71689]:     </nova:instance>
Apr 14 17:05:23 user nova-compute[71689]:   </metadata>
Apr 14 17:05:23 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:05:23 user nova-compute[71689]:     <system>
Apr 14 17:05:23 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:05:23 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:05:23 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:05:23 user nova-compute[71689]:       <entry name="serial">7465a41f-c916-4cca-8084-7c646409007d</entry>
Apr 14 17:05:23 user nova-compute[71689]:       <entry name="uuid">7465a41f-c916-4cca-8084-7c646409007d</entry>
Apr 14 17:05:23 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:05:23 user nova-compute[71689]:     </system>
Apr 14 17:05:23 user nova-compute[71689]:   </sysinfo>
Apr 14 17:05:23 user nova-compute[71689]:   <os>
Apr 14 17:05:23 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:05:23 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:05:23 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:05:23 user nova-compute[71689]:   </os>
Apr 14 17:05:23 user nova-compute[71689]:   <features>
Apr 14 17:05:23 user nova-compute[71689]:     <acpi/>
Apr 14 17:05:23 user nova-compute[71689]:     <apic/>
Apr 14 17:05:23 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:05:23 user nova-compute[71689]:   </features>
Apr 14 17:05:23 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:05:23 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:05:23 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:05:23 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:05:23 user nova-compute[71689]:   </clock>
Apr 14 17:05:23 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:05:23 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:05:23 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:05:23 user nova-compute[71689]:   </cpu>
Apr 14 17:05:23 user nova-compute[71689]:   <devices>
Apr 14 17:05:23 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:05:23 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:05:23 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk"/>
Apr 14 17:05:23 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:05:23 user nova-compute[71689]:     </disk>
Apr 14 17:05:23 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:05:23 user nova-compute[71689]:       <mac address="fa:16:3e:80:d0:2b"/>
Apr 14 17:05:23 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:05:23 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:05:23 user nova-compute[71689]:       <target dev="tap94c17c3d-5f"/>
Apr 14 17:05:23 user nova-compute[71689]:     </interface>
Apr 14 17:05:23 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:05:23 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/console.log" append="off"/>
Apr 14 17:05:23 user nova-compute[71689]:     </serial>
Apr 14 17:05:23 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:05:23 user nova-compute[71689]:     <video>
Apr 14 17:05:23 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:05:23 user nova-compute[71689]:     </video>
Apr 14 17:05:23 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:05:23 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:05:23 user nova-compute[71689]:     </rng>
Apr 14 17:05:23 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:05:23 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:05:23 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:05:23 user nova-compute[71689]:     </memballoon>
Apr 14 17:05:23 user nova-compute[71689]:   </devices>
Apr 14 17:05:23 user nova-compute[71689]: </domain>
Apr 14 17:05:23 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-373292303',display_name='tempest-ServersNegativeTestJSON-server-373292303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-373292303',id=11,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426156fb00db428683851cf731b680d1',ramdisk_id='',reservation_id='r-osz49w3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1832599821',owner_user_name='tempest-ServersNegativeTestJSON-1832599821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:05:21Z,user_data=None,user_id='0d1ea0218b044c1e94f61a07c1d14a75',uuid=7465a41f-c916-4cca-8084-7c646409007d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converting VIF {"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG os_vif [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c17c3d-5f, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94c17c3d-5f, col_values=(('external_ids', {'iface-id': '94c17c3d-5fae-4403-bc19-875a6a0ff264', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:d0:2b', 'vm-uuid': '7465a41f-c916-4cca-8084-7c646409007d'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:23 user nova-compute[71689]: INFO os_vif [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f')
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updated VIF entry in instance network info cache for port 6ed5f4a5-3c4e-48f6-8667-efda89e23575. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] No VIF found with MAC fa:16:3e:80:d0:2b, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-changed-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Refreshing instance network info cache due to event network-changed-adb6bafa-17f9-4c4e-af68-632cc59c3a03. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Acquiring lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Acquired lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Refreshing network info cache for port adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG nova.network.neutron [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Updated VIF entry in instance network info cache for port 94c17c3d-5fae-4403-bc19-875a6a0ff264. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG nova.network.neutron [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Updating instance_info_cache with network_info: [{"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Releasing lock "refresh_cache-7465a41f-c916-4cca-8084-7c646409007d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG nova.network.neutron [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updated VIF entry in instance network info cache for port adb6bafa-17f9-4c4e-af68-632cc59c3a03. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG nova.network.neutron [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updating instance_info_cache with network_info: [{"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Releasing lock "refresh_cache-c0488788-7b88-4c48-9fcd-02640c09feb1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lazy-loading 'flavor' on Instance uuid 6e707b44-e838-4494-9fbc-5698e755e09e {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:25 user nova-compute[71689]: INFO nova.compute.manager [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Attaching volume 6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb to /dev/vdb
Apr 14 17:05:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG os_brick.utils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ab935f-6a3c-4e70-9f47-6e274fbd306d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] No waiting events found dispatching network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:25 user nova-compute[71689]: WARNING nova.compute.manager [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received unexpected event network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance with vm_state building and task_state spawning.
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe835c3-fc3d-4dc1-9acc-f15cd2162e06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e679ce-1666-488f-831b-d3cb4673837c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[818da1e6-5926-44b7-8c2c-5dd8328b8145]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG nova.objects.instance [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:25 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7db33-f5d2-424c-903a-18a3297df1b3]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG os_brick.utils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Updating existing volume attachment record: ae2fd76a-524d-4983-b7f9-b294992f5b96 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:05:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:26 user nova-compute[71689]: INFO nova.compute.manager [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Attaching volume 7ef40a58-0f55-4cad-9da8-5f08f9070aaf to /dev/vdb
Apr 14 17:05:26 user nova-compute[71689]: DEBUG os_brick.utils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b885f3b-e46b-4a2d-a4cf-1c6a4a3c47a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d207bf0c-ca20-4c34-8407-11b517159d90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb93ac5-0334-48e1-b8d3-454caca2a04b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218bbc8-7076-4f59-b7d9-2d03b492190e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:26 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fff96d-e85a-41a4-a9eb-78b60fe055e2]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG os_brick.utils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating existing volume attachment record: dba74166-c110-4ad7-807f-355d20fb3455 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Attaching volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb to /dev/vdb
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491927.2708445, 7465a41f-c916-4cca-8084-7c646409007d => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] VM Resumed (Lifecycle Event)
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Instance spawned successfully.
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG os_brick.utils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491927.2712655, 7465a41f-c916-4cca-8084-7c646409007d => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] VM Started (Lifecycle Event)
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[733832c4-0fe7-4733-91d8-02d292c8ecfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ef95a-3844-4b93-b04b-607e7988e71f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042a722-1ea8-4d86-9cbe-d29bb50fa6bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa336473-5581-4973-991f-41ac09a8d295]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:27 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daa2753-5768-4dc9-bc74-d50a9c3045e1]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG os_brick.utils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updating existing volume attachment record: db3b53fc-6a7a-4796-b5ba-e8e57dc365ec {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] No waiting events found dispatching network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:27 user nova-compute[71689]: WARNING nova.compute.manager [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received unexpected event network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance with vm_state building and task_state spawning.
Apr 14 17:05:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Took 6.78 seconds to build instance.
Apr 14 17:05:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7465a41f-c916-4cca-8084-7c646409007d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.879s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJNgstCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:30 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:30 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:30 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f894d97-9fd5-4503-97d4-86b290de8362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:05:30 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e569e36-c63b-4619-83fc-8c36f9945301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb] added
Apr 14 17:05:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5cedb8-bdde-4405-902a-e7d1d672bdc4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ede564-6e86-4ce7-94bc-44886db46a21]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJNgstCb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJNgstCb" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28480dfd-8e5a-4db6-bce1-0ae15cb8926a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SJNgstCb'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc7bcbf-3630-47cb-847e-f76affd2dbb1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677723c-0088-4d12-bcf4-65c6f5592e6c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d78a8b-0c92-4313-a342-cfb0cea66916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260]
Apr 14 17:05:30 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[663769f7-ded7-49cf-aa33-2fe4d23c1d6b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6957e9f5-397e-4afa-b1bd-f2cc981ad536]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:30 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c315e11-340a-4df1-825e-a8f487219d9b]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJNgstCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:31 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23730636339316463', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730636339316463', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.746s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:31 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:31 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lazy-loading 'flavor' on Instance uuid 6e707b44-e838-4494-9fbc-5698e755e09e {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c317cbbc-a009-4d97-8bde-944db26b7035]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:05:31 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426bb55-6f3b-4a56-b5b2-ed4c2414cf38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf] added
Apr 14 17:05:31 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:05:31 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:31 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:05:31 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:31 user nova-compute[71689]:   <serial>6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb</serial>
Apr 14 17:05:31 user nova-compute[71689]: </disk>
Apr 14 17:05:31 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32da3c1-f133-499c-801d-139e9b746b2d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dfe74a-1598-4b04-bdda-580e5a527309]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjabkIdn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjabkIdn" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3b3f05-a1b1-4f01-94c3-f05a86777621]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjabkIdn'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c08598-4c4f-4abc-bbb9-5dc05cc2ab65]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610744d-3ec6-4684-ae50-e54a9c215cd5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e670c-35ff-4c0f-b987-b55256b6837f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]
Apr 14 17:05:32 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6419f09a-5154-4cb4-bd6c-af50f898fd5c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e49a70-b7e3-429f-a133-80f5bff016cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:32 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf3c71-dcea-4a48-a6b7-6842ab39e69f]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBlDqvpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:32 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] No VIF found with MAC fa:16:3e:64:cc:6f, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.238s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing instance network info cache due to event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:33 user nova-compute[71689]: INFO nova.compute.manager [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Terminating instance
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== connect_volume: return (2177ms) {'type': 'block', 'scsi_wwn': '23733326337363633', 'path': '/dev/sdf'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733326337363633', 'path': '/dev/sdf'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.913s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:33 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:33 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c2c986-90c0-4242-b518-786f7289898f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:05:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:05:33 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:33 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:05:33 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:33 user nova-compute[71689]:   <serial>7ef40a58-0f55-4cad-9da8-5f08f9070aaf</serial>
Apr 14 17:05:33 user nova-compute[71689]: </disk>
Apr 14 17:05:33 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a512a8b-5df0-4635-a87c-a2f358056e34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb] added
Apr 14 17:05:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.network.neutron [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updated VIF entry in instance network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.network.neutron [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3773c6-b28c-44c3-aa0f-cb8cbece4361]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5daad78-f852-458c-9160-a989cef4a67a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBlDqvpF {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBlDqvpF" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f0e32-85c6-4658-b37b-14000dd09584]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBlDqvpF'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[692fc37b-b7ee-4a3f-9e60-a876cda4f3e8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-vif-unplugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] No waiting events found dispatching network-vif-unplugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-vif-unplugged-5572c41c-64e8-4058-9a5e-f3a994e78787 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80450f1-955d-42be-bae4-b845eeb9f767]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b3d7d-d21e-49f9-8203-e5ce209cf4db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260]
Apr 14 17:05:33 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a76bf-a33c-4752-8911-045f4184ddac]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee0e19-9474-4a44-af33-8f3a4ad01d8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:33 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9767941f-7d73-498a-98b0-e7ac25f74e63]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBlDqvpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No VIF found with MAC fa:16:3e:bf:7d:0c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.986s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:34 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Instance destroyed successfully.
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lazy-loading 'resources' on Instance uuid 6e707b44-e838-4494-9fbc-5698e755e09e {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1168352709',display_name='tempest-DeleteServersTestJSON-server-1168352709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1168352709',id=4,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='762a37326f89466c9ee3714ea2e2e905',ramdisk_id='',reservation_id='r-atu8keqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1540294942',owner_user_name='tempest-DeleteServersTestJSON-1540294942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:03:49Z,user_data=None,user_id='740d636ab92c4700b480ea58ce6a30ff',uuid=6e707b44-e838-4494-9fbc-5698e755e09e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Converting VIF {"id": "5572c41c-64e8-4058-9a5e-f3a994e78787", "address": "fa:16:3e:64:cc:6f", "network": {"id": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1769269033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "762a37326f89466c9ee3714ea2e2e905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5572c41c-64", "ovs_interfaceid": "5572c41c-64e8-4058-9a5e-f3a994e78787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_vif [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.compute.manager [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5572c41c-64, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:05:34 user nova-compute[71689]: INFO os_vif [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5572c41c-64e8-4058-9a5e-f3a994e78787,network=Network(0551b00c-c92d-4d9c-affc-e9f25a64ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5572c41c-64')
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJNgstCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:34 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:34 user nova-compute[71689]: INFO nova.compute.manager [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] instance snapshotting
Apr 14 17:05:34 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Beginning live snapshot process
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== connect_volume: return (2290ms) {'type': 'block', 'scsi_wwn': '26631613065393364', 'path': '/dev/sdg'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613065393364', 'path': '/dev/sdg'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.223s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db99174-fc7a-40f5-8b05-06008a61ebbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:05:34 user nova-compute[71689]: No targets found.
Apr 14 17:05:34 user nova-compute[71689]: iSNS:
Apr 14 17:05:34 user nova-compute[71689]: No targets found.
Apr 14 17:05:34 user nova-compute[71689]: STATIC:
Apr 14 17:05:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:05:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:05:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:05:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:05:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:05:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb
Apr 14 17:05:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:34 user nova-compute[71689]: FIRMWARE:
Apr 14 17:05:34 user nova-compute[71689]: No targets found.
Apr 14 17:05:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:05:34 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:05:34 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:05:34 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:34 user nova-compute[71689]:   <source dev="/dev/sdg"/>
Apr 14 17:05:34 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:34 user nova-compute[71689]:   <serial>58c68d43-05ee-458b-b7d0-8bc859d6ebcb</serial>
Apr 14 17:05:34 user nova-compute[71689]: </disk>
Apr 14 17:05:34 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3948b85-f3df-4d81-8608-5028dc8a8bf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4e7dd-4bdf-43fa-93a7-695ddf9a6993]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:34 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c329cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5908059-65ec-4d01-95f2-78cde025daf1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cf418e-a197-488b-9c67-77a10aa09310]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe699ef-746a-4481-a111-952b16368ad3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:05:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e8e62-443c-4d70-8e0f-1f28f6aa3e02]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[94929081-35a9-44a6-85f0-e7688db0a85b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4843bbea-4da8-4c2d-a12f-5e1ae72a6895]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260]
Apr 14 17:05:35 user nova-compute[71689]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:35 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[221af2bc-7d6a-4e26-beb7-02d8e4355d48]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] <== disconnect_volume: return (749ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:05:35 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Deleting instance files /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e_del
Apr 14 17:05:35 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Deletion of /opt/stack/data/nova/instances/6e707b44-e838-4494-9fbc-5698e755e09e_del complete
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71689) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 17:05:35 user nova-compute[71689]: INFO nova.virt.libvirt.host [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] UEFI support detected
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:70:b7:23, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:35 user nova-compute[71689]: INFO nova.compute.manager [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Took 2.37 seconds to destroy the instance on the hypervisor.
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71689) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.189s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8e20jd47/d2f4857cb6ad4f6dbd3a51dbbd33b50a.delta 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Acquiring lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Lock "6e707b44-e838-4494-9fbc-5698e755e09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] No waiting events found dispatching network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:35 user nova-compute[71689]: WARNING nova.compute.manager [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received unexpected event network-vif-plugged-5572c41c-64e8-4058-9a5e-f3a994e78787 for instance with vm_state active and task_state deleting.
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8e20jd47/d2f4857cb6ad4f6dbd3a51dbbd33b50a.delta 1073741824" returned: 0 in 0.120s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:35 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 17:05:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.458s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:36 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:36 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Took 1.00 seconds to deallocate network for instance.
Apr 14 17:05:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Received event network-vif-deleted-5572c41c-64e8-4058-9a5e-f3a994e78787 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:05:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance destroyed successfully.
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.764s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:05:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8e20jd47/d2f4857cb6ad4f6dbd3a51dbbd33b50a.delta /opt/stack/data/nova/instances/snapshots/tmp8e20jd47/d2f4857cb6ad4f6dbd3a51dbbd33b50a {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:37 user nova-compute[71689]: INFO nova.compute.manager [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Took 1.20 seconds to detach 1 volumes for instance.
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8e20jd47/d2f4857cb6ad4f6dbd3a51dbbd33b50a.delta /opt/stack/data/nova/instances/snapshots/tmp8e20jd47/d2f4857cb6ad4f6dbd3a51dbbd33b50a" returned: 0 in 0.256s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Snapshot extracted, beginning image upload
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:37 user nova-compute[71689]: WARNING nova.compute.manager [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:37 user nova-compute[71689]: WARNING nova.compute.manager [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:38 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:05:38 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:05:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:38 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Deleted allocations for instance 6e707b44-e838-4494-9fbc-5698e755e09e
Apr 14 17:05:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "6e707b44-e838-4494-9fbc-5698e755e09e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.343s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:05:39 user nova-compute[71689]: INFO nova.compute.claims [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Claim successful on node user
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:05:40 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Snapshot image upload complete
Apr 14 17:05:40 user nova-compute[71689]: INFO nova.compute.manager [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Took 5.69 seconds to snapshot the instance on the hypervisor.
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:05:40 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.policy [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:05:40 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Creating image(s)
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "/opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.270s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk 1073741824" returned: 0 in 0.057s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Successfully created port: 4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Cannot resize image /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.objects.instance [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'migration_context' on Instance uuid 3469a45b-e63a-4871-a6c5-deece7f4ecfd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Ensure instance console log exists: /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Successfully updated port: 4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquired lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-changed-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Refreshing instance network info cache due to event network-changed-4674caf0-77c1-4de1-a665-db3fde68e9bb. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Acquiring lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Updating instance_info_cache with network_info: [{"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Releasing lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Instance network_info: |[{"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Acquired lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.neutron [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Refreshing network info cache for port 4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Start _get_guest_xml network_info=[{"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:05:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:05:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1521815605',display_name='tempest-AttachVolumeNegativeTest-server-1521815605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1521815605',id=12,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+Zm1ctsV4wvEsTcBuyV4czpQkG0nl/+xyA5iP1tq9gjgmi51R5vjpJ5uOCEzngZBoovymkqc8E81yq7xGrxfiaEQcdxPLfkSbxVyw8dAp1esxCIm+M5nPc8fDIlB6wQ==',key_name='tempest-keypair-122500492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-yituv6ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=3469a45b-e63a-4871-a6c5-deece7f4ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'pci_devices' on Instance uuid 3469a45b-e63a-4871-a6c5-deece7f4ecfd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:05:42 user nova-compute[71689]:   <uuid>3469a45b-e63a-4871-a6c5-deece7f4ecfd</uuid>
Apr 14 17:05:42 user nova-compute[71689]:   <name>instance-0000000c</name>
Apr 14 17:05:42 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:05:42 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:05:42 user nova-compute[71689]:   <metadata>
Apr 14 17:05:42 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:05:42 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:05:42 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1521815605</nova:name>
Apr 14 17:05:42 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:05:42</nova:creationTime>
Apr 14 17:05:42 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:05:42 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:05:42 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:05:42 user nova-compute[71689]:       <nova:owner>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:user uuid="d9c9e0d318eb4ca49d47d620682fb00a">tempest-AttachVolumeNegativeTest-1177875221-project-member</nova:user>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:project uuid="6f341a2096b9483787b569a59f325556">tempest-AttachVolumeNegativeTest-1177875221</nova:project>
Apr 14 17:05:42 user nova-compute[71689]:       </nova:owner>
Apr 14 17:05:42 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:05:42 user nova-compute[71689]:       <nova:ports>
Apr 14 17:05:42 user nova-compute[71689]:         <nova:port uuid="4674caf0-77c1-4de1-a665-db3fde68e9bb">
Apr 14 17:05:42 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 17:05:42 user nova-compute[71689]:         </nova:port>
Apr 14 17:05:42 user nova-compute[71689]:       </nova:ports>
Apr 14 17:05:42 user nova-compute[71689]:     </nova:instance>
Apr 14 17:05:42 user nova-compute[71689]:   </metadata>
Apr 14 17:05:42 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:05:42 user nova-compute[71689]:     <system>
Apr 14 17:05:42 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:05:42 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:05:42 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:05:42 user nova-compute[71689]:       <entry name="serial">3469a45b-e63a-4871-a6c5-deece7f4ecfd</entry>
Apr 14 17:05:42 user nova-compute[71689]:       <entry name="uuid">3469a45b-e63a-4871-a6c5-deece7f4ecfd</entry>
Apr 14 17:05:42 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:05:42 user nova-compute[71689]:     </system>
Apr 14 17:05:42 user nova-compute[71689]:   </sysinfo>
Apr 14 17:05:42 user nova-compute[71689]:   <os>
Apr 14 17:05:42 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:05:42 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:05:42 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:05:42 user nova-compute[71689]:   </os>
Apr 14 17:05:42 user nova-compute[71689]:   <features>
Apr 14 17:05:42 user nova-compute[71689]:     <acpi/>
Apr 14 17:05:42 user nova-compute[71689]:     <apic/>
Apr 14 17:05:42 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:05:42 user nova-compute[71689]:   </features>
Apr 14 17:05:42 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:05:42 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:05:42 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:05:42 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:05:42 user nova-compute[71689]:   </clock>
Apr 14 17:05:42 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:05:42 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:05:42 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:05:42 user nova-compute[71689]:   </cpu>
Apr 14 17:05:42 user nova-compute[71689]:   <devices>
Apr 14 17:05:42 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:05:42 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:05:42 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk"/>
Apr 14 17:05:42 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:05:42 user nova-compute[71689]:     </disk>
Apr 14 17:05:42 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:05:42 user nova-compute[71689]:       <mac address="fa:16:3e:24:53:5d"/>
Apr 14 17:05:42 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:05:42 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:05:42 user nova-compute[71689]:       <target dev="tap4674caf0-77"/>
Apr 14 17:05:42 user nova-compute[71689]:     </interface>
Apr 14 17:05:42 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:05:42 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/console.log" append="off"/>
Apr 14 17:05:42 user nova-compute[71689]:     </serial>
Apr 14 17:05:42 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:05:42 user nova-compute[71689]:     <video>
Apr 14 17:05:42 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:05:42 user nova-compute[71689]:     </video>
Apr 14 17:05:42 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:05:42 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:05:42 user nova-compute[71689]:     </rng>
Apr 14 17:05:42 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:05:42 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:05:42 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:05:42 user nova-compute[71689]:     </memballoon>
Apr 14 17:05:42 user nova-compute[71689]:   </devices>
Apr 14 17:05:42 user nova-compute[71689]: </domain>
Apr 14 17:05:42 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1521815605',display_name='tempest-AttachVolumeNegativeTest-server-1521815605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1521815605',id=12,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+Zm1ctsV4wvEsTcBuyV4czpQkG0nl/+xyA5iP1tq9gjgmi51R5vjpJ5uOCEzngZBoovymkqc8E81yq7xGrxfiaEQcdxPLfkSbxVyw8dAp1esxCIm+M5nPc8fDIlB6wQ==',key_name='tempest-keypair-122500492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-yituv6ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=3469a45b-e63a-4871-a6c5-deece7f4ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG os_vif [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4674caf0-77, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4674caf0-77, col_values=(('external_ids', {'iface-id': '4674caf0-77c1-4de1-a665-db3fde68e9bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:53:5d', 'vm-uuid': '3469a45b-e63a-4871-a6c5-deece7f4ecfd'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:42 user nova-compute[71689]: INFO os_vif [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77')
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:24:53:5d, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Updated VIF entry in instance network info cache for port 4674caf0-77c1-4de1-a665-db3fde68e9bb. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Updating instance_info_cache with network_info: [{"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Releasing lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-changed-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Refreshing instance network info cache due to event network-changed-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Acquiring lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Acquired lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.network.neutron [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Refreshing network info cache for port 0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] No waiting events found dispatching network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:44 user nova-compute[71689]: WARNING nova.compute.manager [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received unexpected event network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb for instance with vm_state building and task_state spawning.
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.network.neutron [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updated VIF entry in instance network info cache for port 0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG nova.network.neutron [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updating instance_info_cache with network_info: [{"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Releasing lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491946.539129, 3469a45b-e63a-4871-a6c5-deece7f4ecfd => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] VM Resumed (Lifecycle Event)
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Instance spawned successfully.
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] No waiting events found dispatching network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:46 user nova-compute[71689]: WARNING nova.compute.manager [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received unexpected event network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb for instance with vm_state building and task_state spawning.
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681491946.5439968, 3469a45b-e63a-4871-a6c5-deece7f4ecfd => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] VM Started (Lifecycle Event)
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Took 6.00 seconds to spawn the instance on the hypervisor.
Apr 14 17:05:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:46 user nova-compute[71689]: INFO nova.compute.manager [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Took 7.02 seconds to build instance.
Apr 14 17:05:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.131s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG nova.objects.instance [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'flavor' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:47 user nova-compute[71689]: INFO nova.compute.manager [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Attaching volume 4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 to /dev/vdb
Apr 14 17:05:47 user nova-compute[71689]: DEBUG os_brick.utils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[46434c1a-beda-4202-9e6c-99dc110ea33a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14c47f-b180-495c-894e-68b7aae812f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c445f416-ea4d-40e9-b6f2-68b162fe0c47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a48a76-aaa9-442b-aadc-51b9206fd89c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:47 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac984dd-6459-431d-8018-f9c4027e7861]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG os_brick.utils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updating existing volume attachment record: 68cea89e-9c91-4be3-b53e-865c94bb628f {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:05:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-changed-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Refreshing instance network info cache due to event network-changed-3c8c7d04-4fcc-498a-b858-122cea028627. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Acquiring lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Acquired lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Refreshing network info cache for port 3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:49 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681491934.0907292, 6e707b44-e838-4494-9fbc-5698e755e09e => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:49 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] VM Stopped (Lifecycle Event)
Apr 14 17:05:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-a08ccd41-d8ef-4139-a2c3-fdcd15bc14c9 None None] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:49 user nova-compute[71689]: DEBUG nova.network.neutron [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Updated VIF entry in instance network info cache for port 3c8c7d04-4fcc-498a-b858-122cea028627. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:49 user nova-compute[71689]: DEBUG nova.network.neutron [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Updating instance_info_cache with network_info: [{"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Releasing lock "refresh_cache-80bd1dd9-b80e-4533-98d5-0ca798bc4be9" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-changed-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Refreshing instance network info cache due to event network-changed-dfe61768-29ed-4753-b77a-dcc14e1ce6c2. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Acquiring lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Acquired lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Refreshing network info cache for port dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'flavor' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:51 user nova-compute[71689]: INFO nova.compute.manager [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Attaching volume 3efe6a50-62c4-4eae-a012-2d4a71faa73f to /dev/vdb
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.utils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae2dce0-d2b9-4786-b96e-3e4047936b55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b1e52-f1c7-4a16-bf56-47b846a77fd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe658d-a354-4c7d-bf84-7279afb99404]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae093b-2b0a-4d63-b50d-77d214991f95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updated VIF entry in instance network info cache for port dfe61768-29ed-4753-b77a-dcc14e1ce6c2. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updating instance_info_cache with network_info: [{"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:51 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf2d43c-62ba-49b7-9b4b-ca686232c1de]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.utils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updating existing volume attachment record: fc1341dc-f096-43bb-a5ea-ea4664dccf04 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Releasing lock "refresh_cache-f53cfe1f-c915-4a74-8512-84a97147f1d1" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'flavor' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:51 user nova-compute[71689]: INFO nova.compute.manager [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Attaching volume 2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed to /dev/sdc
Apr 14 17:05:51 user nova-compute[71689]: DEBUG os_brick.utils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1014fac2-d1b4-40e8-8767-ec0c7c81d31d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f2c14-45f8-426c-8b77-b1db9faeffac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b1052c-097e-4a6d-be7a-2e70a5d41fc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd81eb5-791b-485d-be6c-787462944900]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:52 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91f939-bccf-41fa-8131-ae99fb2c09c1]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.utils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Updating existing volume attachment record: 8a7f78b7-f990-47bb-829d-fa2e369561c5 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681491937.045056, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:05:52 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Stopped (Lifecycle Event)
Apr 14 17:05:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-88cf9cc8-48e6-4c65-aa13-14a7a7f48459 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-88cf9cc8-48e6-4c65-aa13-14a7a7f48459 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzPONJwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:52 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:52 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:52 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41fce9-f085-4b8d-a990-cdc660b26c2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:05:52 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb88c02-b6dc-460d-b70c-2f7a8f1cb026]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46] added
Apr 14 17:05:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b8bac1-e98f-4470-8fd6-f8dbf5522e6d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622fe0f-dda7-4f49-ad9a-c1e4652bba38]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzPONJwU {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzPONJwU" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d78b8-efcf-4d90-8a47-4036ed0d6e73]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzPONJwU'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ad523b-d1de-44f4-b349-0122f3b561be]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[167fad1f-0ef4-44f5-92f9-e2474f6e3358]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d70cde-ac50-4a87-bb93-729df1618089]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260]
Apr 14 17:05:52 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a843a0e-1ea3-4379-b6dd-d6e98627ef8b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64040c-58f1-4d1a-a64d-7350b82fddc4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:52 user nova-compute[71689]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 (non-flash)
Apr 14 17:05:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49c709-3456-48a6-8b54-2cd964f1df89]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzPONJwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:05:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23032623638366161', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032623638366161', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:05:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'flavor' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:05:53 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:53 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:05:53 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:53 user nova-compute[71689]:   <serial>4614e3e7-fd7a-4c08-97f7-c83cf4e18c46</serial>
Apr 14 17:05:53 user nova-compute[71689]: </disk>
Apr 14 17:05:53 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No VIF found with MAC fa:16:3e:a7:bb:57, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.946s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:55 user nova-compute[71689]: INFO nova.compute.manager [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Detaching volume 4614e3e7-fd7a-4c08-97f7-c83cf4e18c46
Apr 14 17:05:55 user nova-compute[71689]: INFO nova.virt.block_device [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Attempting to driver detach volume 4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 from mountpoint /dev/vdb
Apr 14 17:05:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Attempting to detach device vdb from instance add03bde-bc0e-436a-a994-e81c3f75e4c4 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:05:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:05:55 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:55 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:05:55 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:55 user nova-compute[71689]:   <serial>4614e3e7-fd7a-4c08-97f7-c83cf4e18c46</serial>
Apr 14 17:05:55 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:05:55 user nova-compute[71689]: </disk>
Apr 14 17:05:55 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:05:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Successfully detached device vdb from instance add03bde-bc0e-436a-a994-e81c3f75e4c4 from the persistent domain config.
Apr 14 17:05:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance add03bde-bc0e-436a-a994-e81c3f75e4c4 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:05:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:05:55 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:55 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:05:55 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:55 user nova-compute[71689]:   <serial>4614e3e7-fd7a-4c08-97f7-c83cf4e18c46</serial>
Apr 14 17:05:55 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:05:55 user nova-compute[71689]: </disk>
Apr 14 17:05:55 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681491956.157882, add03bde-bc0e-436a-a994-e81c3f75e4c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:05:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Successfully detached device vdb from instance add03bde-bc0e-436a-a994-e81c3f75e4c4 from the live domain config.
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzPONJwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:56 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:56 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1592fe3d-b7b3-4e5d-8fa5-58dc90d160d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:05:56 user nova-compute[71689]: No targets found.
Apr 14 17:05:56 user nova-compute[71689]: iSNS:
Apr 14 17:05:56 user nova-compute[71689]: No targets found.
Apr 14 17:05:56 user nova-compute[71689]: STATIC:
Apr 14 17:05:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:05:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:05:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:05:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:05:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46
Apr 14 17:05:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:05:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:05:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:05:56 user nova-compute[71689]: FIRMWARE:
Apr 14 17:05:56 user nova-compute[71689]: No targets found.
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:05:56 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:05:56 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a801d7f7-fc44-49f7-a2d0-b6a30b1ad6f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b40b93-6beb-4a4d-96cb-37590d775482]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c4fc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743aace-615d-4e5e-b820-af1336669d0e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f923a-458a-422b-948d-9ddbcc2bb654]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-changed-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Refreshing instance network info cache due to event network-changed-34ea1bd9-f010-4073-bf8d-351b0e85ceeb. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Acquiring lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Acquired lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.network.neutron [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Refreshing network info cache for port 34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7976a64c-2021-4395-83cd-417da613f518]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc81ff1e-8f87-485d-af52-6de90886ebe4]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd1d26-a5a6-4dfd-9583-dfa3eea5f045]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[621219e6-8dcf-4209-9cf3-38319f35562d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260]
Apr 14 17:05:56 user nova-compute[71689]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[246cb810-ad70-4a07-abb1-91d4832d80b3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] <== disconnect_volume: return (343ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.349s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:56 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:56 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635a958-c76a-43b5-a518-eca4a1122ec8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:05:56 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae829a5e-fdac-480e-b125-d4fca9147bd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f] added
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7fe9da-aa93-44fe-9906-9c60d5600b68]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[978aa215-8447-4a4f-a652-6db06d341c1c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCmeBxcy {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCmeBxcy" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b0f20a-a61b-4ad0-87b6-a7fef9684a18]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCmeBxcy'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea978d-a58c-45de-b3b1-56c054482d77]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f53c7c4-006b-4df0-b34e-bac6dacf3f5a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "interface-113dda5c-a61e-423b-86ea-2fe30a113173-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "interface-113dda5c-a61e-423b-86ea-2fe30a113173-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'flavor' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.network.neutron [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updated VIF entry in instance network info cache for port 34ea1bd9-f010-4073-bf8d-351b0e85ceeb. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.network.neutron [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83d554-17bd-4a84-bc15-148381e3ff65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]
Apr 14 17:05:56 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Releasing lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[377bb491-72c0-4d03-8d4a-682786888113]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e06fd3-accb-4912-a389-0f86cf1fbe50]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:56 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:05:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d6d54-4110-40b5-b39d-c3aecdfe110a]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'pci_requests' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNKXGYvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:57 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.policy [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'flavor' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.908s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Successfully created port: 01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] <== connect_volume: return (1739ms) {'type': 'block', 'scsi_wwn': '26137323832613330', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137323832613330', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.910s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:57 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:05:57 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'flavor' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2019e887-222e-468c-837d-c95e4d0c9927]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:05:57 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:05:57 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:57 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:05:57 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:05:57 user nova-compute[71689]:   <serial>3efe6a50-62c4-4eae-a012-2d4a71faa73f</serial>
Apr 14 17:05:57 user nova-compute[71689]: </disk>
Apr 14 17:05:57 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9151952e-7c35-4495-8535-e0c24cc7da6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed] added
Apr 14 17:05:57 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c4f43-c397-403c-a1d0-bff584f6fe09]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[595eb486-ed2f-4969-87e3-31f2fd318414]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNKXGYvx {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNKXGYvx" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fcbf5d-edd4-47be-8fc9-54316cdde322]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fNKXGYvx'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c15c9ad-6c9d-475a-88e8-08ef74a178f6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a418cd-7af5-461f-888e-b7a9bc38fe39]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:05:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:05:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c5b016-8fe5-446c-9e87-858083b57a55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260]
Apr 14 17:05:58 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260] successful.
Apr 14 17:05:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d9515-c6fb-4d4b-9d91-ce36b85d9920]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ebc5dd-94a7-4c15-9a04-10bc0afd6926]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:05:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:05:58 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:05:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac792d1c-7a2b-48d8-97ce-6b127e16a264]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNKXGYvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Successfully updated port: 01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquired lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-changed-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Refreshing instance network info cache due to event network-changed-01bf74ae-32c2-4241-9a37-abba15fe3de6. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Acquiring lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] No VIF found with MAC fa:16:3e:3e:a5:f6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.443s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Releasing lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Acquired lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Refreshing network info cache for port 01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_vif [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01bf74ae-32, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01bf74ae-32, col_values=(('external_ids', {'iface-id': '01bf74ae-32c2-4241-9a37-abba15fe3de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:84:4c', 'vm-uuid': '113dda5c-a61e-423b-86ea-2fe30a113173'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: INFO os_vif [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32')
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] attach device xml: <interface type="ethernet">
Apr 14 17:05:59 user nova-compute[71689]:   <mac address="fa:16:3e:58:84:4c"/>
Apr 14 17:05:59 user nova-compute[71689]:   <model type="virtio"/>
Apr 14 17:05:59 user nova-compute[71689]:   <mtu size="1442"/>
Apr 14 17:05:59 user nova-compute[71689]:   <target dev="tap01bf74ae-32"/>
Apr 14 17:05:59 user nova-compute[71689]: </interface>
Apr 14 17:05:59 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] <== connect_volume: return (2280ms) {'type': 'block', 'scsi_wwn': '26134323631356138', 'path': '/dev/sdh'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134323631356138', 'path': '/dev/sdh'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'flavor' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:05:59 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:05:59 user nova-compute[71689]:   <source dev="/dev/sdh"/>
Apr 14 17:05:59 user nova-compute[71689]:   <target dev="sdc" bus="scsi"/>
Apr 14 17:05:59 user nova-compute[71689]:   <serial>2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed</serial>
Apr 14 17:05:59 user nova-compute[71689]:   <address type="drive" controller="0" unit="2"/>
Apr 14 17:05:59 user nova-compute[71689]: </disk>
Apr 14 17:05:59 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.utils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aab195-af25-4570-b71c-1fa34fb7a8b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c45353-95ab-4619-bc25-e4f6d690998c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:05:59 user nova-compute[71689]: WARNING nova.compute.manager [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance with vm_state active and task_state None.
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6720a9a0-f3bf-4a45-beff-b31c16500fc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7affcfc-c4fa-46a4-b0ff-e8dac47d560e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:05:59 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6741c8-b491-40cb-ba81-569874a575e3]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG os_brick.utils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No BDM found with device name hda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No VIF found with MAC fa:16:3e:37:3a:79, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:05:59 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:05:59 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:05:59 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:05:59</nova:creationTime>
Apr 14 17:05:59 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:05:59 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:05:59 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:05:59 user nova-compute[71689]:   <nova:owner>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:05:59 user nova-compute[71689]:   </nova:owner>
Apr 14 17:05:59 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:05:59 user nova-compute[71689]:   <nova:ports>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:05:59 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:05:59 user nova-compute[71689]:     </nova:port>
Apr 14 17:05:59 user nova-compute[71689]:     <nova:port uuid="01bf74ae-32c2-4241-9a37-abba15fe3de6">
Apr 14 17:05:59 user nova-compute[71689]:       <nova:ip type="fixed" address="10.10.10.115" ipVersion="4"/>
Apr 14 17:05:59 user nova-compute[71689]:     </nova:port>
Apr 14 17:05:59 user nova-compute[71689]:   </nova:ports>
Apr 14 17:05:59 user nova-compute[71689]: </nova:instance>
Apr 14 17:05:59 user nova-compute[71689]:  {{(pid=71689) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updated VIF entry in instance network info cache for port 01bf74ae-32c2-4241-9a37-abba15fe3de6. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "interface-113dda5c-a61e-423b-86ea-2fe30a113173-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.938s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Releasing lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:05:59 user nova-compute[71689]: INFO nova.compute.manager [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Swapping volume 3efe6a50-62c4-4eae-a012-2d4a71faa73f for fa07d38e-7ab2-4439-b17f-e6a139923ab3
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:05:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No BDM found with device name sda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] No VIF found with MAC fa:16:3e:da:f7:47, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'flavor' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.323s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:00 user nova-compute[71689]: INFO nova.compute.manager [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Attaching volume 1460b147-25a9-4883-9e94-a963003b7e58 to /dev/vdb
Apr 14 17:06:00 user nova-compute[71689]: DEBUG os_brick.utils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadc1e7-247d-4794-b47b-78c0caef9d77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f87eb-e3f4-4740-9767-cd687d1d8ada]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27133cf-f08c-4fb5-abcf-cb23eb1b8f6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[46228609-25f4-4e7e-98df-8995fe675560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:06:00 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c629c-1bcc-4a41-81e6-ea851a72db78]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG os_brick.utils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating existing volume attachment record: c19195c7-d114-48e4-aec5-41b72eaf09eb {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:00 user nova-compute[71689]: INFO nova.compute.manager [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Detaching volume 2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed
Apr 14 17:06:00 user nova-compute[71689]: INFO nova.virt.block_device [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Attempting to driver detach volume 2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed from mountpoint /dev/sdc
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Attempting to detach device sdc from instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:06:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:06:00 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:00 user nova-compute[71689]:   <source dev="/dev/sdh"/>
Apr 14 17:06:00 user nova-compute[71689]:   <target dev="sdc" bus="scsi"/>
Apr 14 17:06:00 user nova-compute[71689]:   <serial>2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed</serial>
Apr 14 17:06:00 user nova-compute[71689]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 17:06:00 user nova-compute[71689]: </disk>
Apr 14 17:06:00 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Successfully detached device sdc from instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 from the persistent domain config.
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:06:01 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:01 user nova-compute[71689]:   <source dev="/dev/sdh"/>
Apr 14 17:06:01 user nova-compute[71689]:   <target dev="sdc" bus="scsi"/>
Apr 14 17:06:01 user nova-compute[71689]:   <serial>2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed</serial>
Apr 14 17:06:01 user nova-compute[71689]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 17:06:01 user nova-compute[71689]: </disk>
Apr 14 17:06:01 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681491961.383554, 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:06:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Successfully detached device sdc from instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 from the live domain config.
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNKXGYvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6205df00-3f9c-44bd-a14f-5263e67316fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:01 user nova-compute[71689]: No targets found.
Apr 14 17:06:01 user nova-compute[71689]: iSNS:
Apr 14 17:06:01 user nova-compute[71689]: No targets found.
Apr 14 17:06:01 user nova-compute[71689]: STATIC:
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed
Apr 14 17:06:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:01 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:01 user nova-compute[71689]: No targets found.
Apr 14 17:06:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:01 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:01 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f23ca-b8ba-440c-8b34-f72e28db2636]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d134110-f69d-45c5-ba57-e7f954e60dd0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:01 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c329d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed'): ({'sdh'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Removing single pathed devices sdh {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e445ed-4905-444c-8623-415632a25aa6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[828f3859-48eb-4680-a540-c60390682e17]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Flushing IO for device /dev/sdh {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c25e2a4-babf-46ff-902d-769e7a28d8fa]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:01 user nova-compute[71689]: WARNING nova.compute.manager [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance with vm_state active and task_state None.
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a70a46-ae6b-480e-823c-cd0d8786527e]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] SCSI volumes sdh have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e440fcc-e6a0-4c26-8dbd-d28d53cd449d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901466b-ab07-44ac-aa2c-360cd670b0a1]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260]
Apr 14 17:06:01 user nova-compute[71689]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b9bf05-bc74-4622-b6a9-4746db48bbc7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] <== disconnect_volume: return (343ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:04 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'flavor' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.998s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrmAnfHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:05 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:05 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:05 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e92045-00f1-4271-9807-6f472178ad13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:06:05 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQXHseO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f53cfe1f-c915-4a74-8512-84a97147f1d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'serial': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f53cfe1f-c915-4a74-8512-84a97147f1d1', 'attached_at': '', 'detached_at': '', 'volume_id': '3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'serial'} {{(pid=71689) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQXHseO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:05 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a370386d-581c-442e-8104-28dbb906adef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58] added
Apr 14 17:06:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[27072f2c-399a-4652-9b3f-27432d42bf7f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f602c95c-378c-4ce6-a841-eed1e87d2106]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrmAnfHt {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrmAnfHt" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f091f9-d348-4f9d-ba0f-b2ff039ce116]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrmAnfHt'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9187d70-c0bf-4cf8-90cc-40abd51e7289]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aa39ed-46f8-4db6-9620-0f85fe1f924e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:05 user nova-compute[71689]: INFO nova.compute.manager [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Terminating instance
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8c344c-89cb-43d9-ba2d-27cd77b28de5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260]
Apr 14 17:06:05 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62074d5-e819-4f61-b11e-34f933d218df]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576b65f-250c-4c93-84c1-4b2248b0f86d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:05 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d060b550-1010-4aeb-9174-54698295f3a4]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrmAnfHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-vif-unplugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] No waiting events found dispatching network-vif-unplugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-vif-unplugged-3c8c7d04-4fcc-498a-b858-122cea028627 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Instance destroyed successfully.
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.objects.instance [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'resources' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1187816968',display_name='tempest-AttachSCSIVolumeTestJSON-server-1187816968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1187816968',id=7,image_ref='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt3AY0twBFJ/11W/wY1p+QHYZ5ZYF1ev1xFPxqsjQhohjW4GbK0pSGxU9yjNPkGClqmdyRmx+s0HpdzC0OQNkLSSuKwBe8eYLrWtvXtdg9FZxi6K1gvFXpYZYaXxHyN4g==',key_name='tempest-keypair-1254425015',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6431ad1110e748baaab4a94037e60782',ramdisk_id='',reservation_id='r-waoeldiq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1459567257',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1459567257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d53afcd6995e4e7dbced957359802022',uuid=80bd1dd9-b80e-4533-98d5-0ca798bc4be9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Converting VIF {"id": "3c8c7d04-4fcc-498a-b858-122cea028627", "address": "fa:16:3e:da:f7:47", "network": {"id": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1946376836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6431ad1110e748baaab4a94037e60782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8c7d04-4f", "ovs_interfaceid": "3c8c7d04-4fcc-498a-b858-122cea028627", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_vif [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c8c7d04-4f, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:06 user nova-compute[71689]: INFO os_vif [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:f7:47,bridge_name='br-int',has_traffic_filtering=True,id=3c8c7d04-4fcc-498a-b858-122cea028627,network=Network(4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8c7d04-4f')
Apr 14 17:06:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Deleting instance files /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9_del
Apr 14 17:06:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Deletion of /opt/stack/data/nova/instances/80bd1dd9-b80e-4533-98d5-0ca798bc4be9_del complete
Apr 14 17:06:06 user nova-compute[71689]: INFO nova.compute.manager [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23162306232383666', 'path': '/dev/sdh'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162306232383666', 'path': '/dev/sdh'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.318s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:06 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:06 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'flavor' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6e0e7-2e89-4412-98fd-d2aa96f1ea31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:06:06 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:06:06 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:06 user nova-compute[71689]:   <source dev="/dev/sdh"/>
Apr 14 17:06:06 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:06:06 user nova-compute[71689]:   <serial>1460b147-25a9-4883-9e94-a963003b7e58</serial>
Apr 14 17:06:06 user nova-compute[71689]: </disk>
Apr 14 17:06:06 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef703488-3486-401f-a610-5db10e04929c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3] added
Apr 14 17:06:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[67965f40-30be-4493-a089-8f031bbc3ea9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[571300eb-be1f-45aa-be5e-775e96e85bad]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZQXHseO {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZQXHseO" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250c9a3-49f3-4e1c-82e9-da7c653d7cc7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZQXHseO'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e053fb-c825-4086-ad02-d37012f481af]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed905a-a504-4aa2-bf81-e2be2715ee8b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ed0c41-f685-4184-9b8d-0854845694ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260]
Apr 14 17:06:06 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a048730f-3f8d-4e92-87c0-39f1fdcd631e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec63ac-fd29-481b-89a1-4003ccb97e20]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:06 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8190577-a4c5-4911-ac6b-0b086f7fae7d]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQXHseO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No BDM found with device name hda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:06:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] No VIF found with MAC fa:16:3e:37:3a:79, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.726s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:07 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Took 0.95 seconds to deallocate network for instance.
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:07 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Deleted allocations for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:07 user nova-compute[71689]: INFO nova.compute.manager [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Detaching volume 1460b147-25a9-4883-9e94-a963003b7e58
Apr 14 17:06:07 user nova-compute[71689]: INFO nova.virt.block_device [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Attempting to driver detach volume 1460b147-25a9-4883-9e94-a963003b7e58 from mountpoint /dev/vdb
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Attempting to detach device vdb from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:06:07 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:07 user nova-compute[71689]:   <source dev="/dev/sdh"/>
Apr 14 17:06:07 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:06:07 user nova-compute[71689]:   <serial>1460b147-25a9-4883-9e94-a963003b7e58</serial>
Apr 14 17:06:07 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 17:06:07 user nova-compute[71689]: </disk>
Apr 14 17:06:07 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:07 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully detached device vdb from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the persistent domain config.
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:06:07 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:07 user nova-compute[71689]:   <source dev="/dev/sdh"/>
Apr 14 17:06:07 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:06:07 user nova-compute[71689]:   <serial>1460b147-25a9-4883-9e94-a963003b7e58</serial>
Apr 14 17:06:07 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 17:06:07 user nova-compute[71689]: </disk>
Apr 14 17:06:07 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] <== connect_volume: return (2664ms) {'type': 'block', 'scsi_wwn': '23030363334316430', 'path': '/dev/sdi'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030363334316430', 'path': '/dev/sdi'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Acquiring lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Lock "80bd1dd9-b80e-4533-98d5-0ca798bc4be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] No waiting events found dispatching network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:07 user nova-compute[71689]: WARNING nova.compute.manager [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received unexpected event network-vif-plugged-3c8c7d04-4fcc-498a-b858-122cea028627 for instance with vm_state deleted and task_state None.
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Received event network-vif-deleted-3c8c7d04-4fcc-498a-b858-122cea028627 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lazy-loading 'flavor' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681491968.16923, 113dda5c-a61e-423b-86ea-2fe30a113173 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:06:08 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully detached device vdb from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the live domain config.
Apr 14 17:06:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrmAnfHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:08 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9065680f-9f29-4aa6-81a5-2a990172003b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:08 user nova-compute[71689]: No targets found.
Apr 14 17:06:08 user nova-compute[71689]: iSNS:
Apr 14 17:06:08 user nova-compute[71689]: No targets found.
Apr 14 17:06:08 user nova-compute[71689]: STATIC:
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58
Apr 14 17:06:08 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:08 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:08 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:08 user nova-compute[71689]: No targets found.
Apr 14 17:06:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:08 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:08 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370acb2-98a3-4c6b-bed0-99431fc08a37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad03172-6444-4580-a8f6-2020708da39f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:08 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c356f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58'): ({'sdh'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Removing single pathed devices sdh {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c4c388-eee1-48b3-aa0b-d3e066af1d2c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e7b34-a95e-4e00-89e9-382b09f887d8]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Flushing IO for device /dev/sdh {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30c52d-f630-442e-bf03-b4eb82286a0b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b995c40-e512-448c-9d48-20ca2c2d13af]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] SCSI volumes sdh have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae5804a-76fa-4d1c-855a-b1d5d5fc3a65]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42e41b3-52b7-4a25-8dbd-3c6ca08f56bd]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260]
Apr 14 17:06:08 user nova-compute[71689]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1460b147-25a9-4883-9e94-a963003b7e58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[88190acf-1021-43f1-815a-8557ebd90418]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] <== disconnect_volume: return (333ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 104857600 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 230686720 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG nova.objects.instance [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'flavor' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.157s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "interface-113dda5c-a61e-423b-86ea-2fe30a113173-01bf74ae-32c2-4241-9a37-abba15fe3de6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "interface-113dda5c-a61e-423b-86ea-2fe30a113173-01bf74ae-32c2-4241-9a37-abba15fe3de6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.objects.instance [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'flavor' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface> {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface> {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Attempting to detach device tap01bf74ae-32 from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] detach device xml: <interface type="ethernet">
Apr 14 17:06:10 user nova-compute[71689]:   <mac address="fa:16:3e:58:84:4c"/>
Apr 14 17:06:10 user nova-compute[71689]:   <model type="virtio"/>
Apr 14 17:06:10 user nova-compute[71689]:   <mtu size="1442"/>
Apr 14 17:06:10 user nova-compute[71689]:   <target dev="tap01bf74ae-32"/>
Apr 14 17:06:10 user nova-compute[71689]: </interface>
Apr 14 17:06:10 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface> {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 17:06:10 user nova-compute[71689]:   <name>instance-00000009</name>
Apr 14 17:06:10 user nova-compute[71689]:   <uuid>113dda5c-a61e-423b-86ea-2fe30a113173</uuid>
Apr 14 17:06:10 user nova-compute[71689]:   <metadata>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:10 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:05:59</nova:creationTime>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:06:10 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:owner>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:owner>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:ports>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:06:10 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:06:10 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:port uuid="01bf74ae-32c2-4241-9a37-abba15fe3de6">
Apr 14 17:06:10 user nova-compute[71689]:       <nova:ip type="fixed" address="10.10.10.115" ipVersion="4"/>
Apr 14 17:06:10 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:ports>
Apr 14 17:06:10 user nova-compute[71689]: </nova:instance>
Apr 14 17:06:10 user nova-compute[71689]:   </metadata>
Apr 14 17:06:10 user nova-compute[71689]:   <memory unit='KiB'>131072</memory>
Apr 14 17:06:10 user nova-compute[71689]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 17:06:10 user nova-compute[71689]:   <vcpu placement='static'>1</vcpu>
Apr 14 17:06:10 user nova-compute[71689]:   <resource>
Apr 14 17:06:10 user nova-compute[71689]:     <partition>/machine</partition>
Apr 14 17:06:10 user nova-compute[71689]:   </resource>
Apr 14 17:06:10 user nova-compute[71689]:   <sysinfo type='smbios'>
Apr 14 17:06:10 user nova-compute[71689]:     <system>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='version'>0.0.0</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='serial'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='uuid'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='family'>Virtual Machine</entry>
Apr 14 17:06:10 user nova-compute[71689]:     </system>
Apr 14 17:06:10 user nova-compute[71689]:   </sysinfo>
Apr 14 17:06:10 user nova-compute[71689]:   <os>
Apr 14 17:06:10 user nova-compute[71689]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 17:06:10 user nova-compute[71689]:     <boot dev='hd'/>
Apr 14 17:06:10 user nova-compute[71689]:     <smbios mode='sysinfo'/>
Apr 14 17:06:10 user nova-compute[71689]:   </os>
Apr 14 17:06:10 user nova-compute[71689]:   <features>
Apr 14 17:06:10 user nova-compute[71689]:     <acpi/>
Apr 14 17:06:10 user nova-compute[71689]:     <apic/>
Apr 14 17:06:10 user nova-compute[71689]:     <vmcoreinfo state='on'/>
Apr 14 17:06:10 user nova-compute[71689]:   </features>
Apr 14 17:06:10 user nova-compute[71689]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 17:06:10 user nova-compute[71689]:     <model fallback='forbid'>Nehalem</model>
Apr 14 17:06:10 user nova-compute[71689]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 17:06:10 user nova-compute[71689]:     <feature policy='require' name='vme'/>
Apr 14 17:06:10 user nova-compute[71689]:     <feature policy='require' name='x2apic'/>
Apr 14 17:06:10 user nova-compute[71689]:     <feature policy='require' name='hypervisor'/>
Apr 14 17:06:10 user nova-compute[71689]:   </cpu>
Apr 14 17:06:10 user nova-compute[71689]:   <clock offset='utc'>
Apr 14 17:06:10 user nova-compute[71689]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 17:06:10 user nova-compute[71689]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 17:06:10 user nova-compute[71689]:     <timer name='hpet' present='no'/>
Apr 14 17:06:10 user nova-compute[71689]:   </clock>
Apr 14 17:06:10 user nova-compute[71689]:   <on_poweroff>destroy</on_poweroff>
Apr 14 17:06:10 user nova-compute[71689]:   <on_reboot>restart</on_reboot>
Apr 14 17:06:10 user nova-compute[71689]:   <on_crash>destroy</on_crash>
Apr 14 17:06:10 user nova-compute[71689]:   <devices>
Apr 14 17:06:10 user nova-compute[71689]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 17:06:10 user nova-compute[71689]:     <disk type='file' device='disk'>
Apr 14 17:06:10 user nova-compute[71689]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 17:06:10 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk' index='2'/>
Apr 14 17:06:10 user nova-compute[71689]:       <backingStore type='file' index='3'>
Apr 14 17:06:10 user nova-compute[71689]:         <format type='raw'/>
Apr 14 17:06:10 user nova-compute[71689]:         <source file='/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350'/>
Apr 14 17:06:10 user nova-compute[71689]:         <backingStore/>
Apr 14 17:06:10 user nova-compute[71689]:       </backingStore>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='vda' bus='virtio'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='virtio-disk0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </disk>
Apr 14 17:06:10 user nova-compute[71689]:     <disk type='file' device='cdrom'>
Apr 14 17:06:10 user nova-compute[71689]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 17:06:10 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config' index='1'/>
Apr 14 17:06:10 user nova-compute[71689]:       <backingStore/>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='hda' bus='ide'/>
Apr 14 17:06:10 user nova-compute[71689]:       <readonly/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='ide0-0-0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </disk>
Apr 14 17:06:10 user nova-compute[71689]:     <controller type='usb' index='0' model='none'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='usb'/>
Apr 14 17:06:10 user nova-compute[71689]:     </controller>
Apr 14 17:06:10 user nova-compute[71689]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='pci.0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </controller>
Apr 14 17:06:10 user nova-compute[71689]:     <controller type='ide' index='0'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='ide'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 17:06:10 user nova-compute[71689]:     </controller>
Apr 14 17:06:10 user nova-compute[71689]:     <interface type='ethernet'>
Apr 14 17:06:10 user nova-compute[71689]:       <mac address='fa:16:3e:37:3a:79'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='tap34ea1bd9-f0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <model type='virtio'/>
Apr 14 17:06:10 user nova-compute[71689]:       <mtu size='1442'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='net0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </interface>
Apr 14 17:06:10 user nova-compute[71689]:     <interface type='ethernet'>
Apr 14 17:06:10 user nova-compute[71689]:       <mac address='fa:16:3e:58:84:4c'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='tap01bf74ae-32'/>
Apr 14 17:06:10 user nova-compute[71689]:       <model type='virtio'/>
Apr 14 17:06:10 user nova-compute[71689]:       <mtu size='1442'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='net1'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </interface>
Apr 14 17:06:10 user nova-compute[71689]:     <serial type='pty'>
Apr 14 17:06:10 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:10 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target type='isa-serial' port='0'>
Apr 14 17:06:10 user nova-compute[71689]:         <model name='isa-serial'/>
Apr 14 17:06:10 user nova-compute[71689]:       </target>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </serial>
Apr 14 17:06:10 user nova-compute[71689]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 17:06:10 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:10 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target type='serial' port='0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </console>
Apr 14 17:06:10 user nova-compute[71689]:     <input type='mouse' bus='ps2'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='input0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </input>
Apr 14 17:06:10 user nova-compute[71689]:     <input type='keyboard' bus='ps2'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='input1'/>
Apr 14 17:06:10 user nova-compute[71689]:     </input>
Apr 14 17:06:10 user nova-compute[71689]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 17:06:10 user nova-compute[71689]:       <listen type='address' address='0.0.0.0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </graphics>
Apr 14 17:06:10 user nova-compute[71689]:     <audio id='1' type='none'/>
Apr 14 17:06:10 user nova-compute[71689]:     <video>
Apr 14 17:06:10 user nova-compute[71689]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='video0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </video>
Apr 14 17:06:10 user nova-compute[71689]:     <memballoon model='virtio'>
Apr 14 17:06:10 user nova-compute[71689]:       <stats period='10'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='balloon0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </memballoon>
Apr 14 17:06:10 user nova-compute[71689]:     <rng model='virtio'>
Apr 14 17:06:10 user nova-compute[71689]:       <backend model='random'>/dev/urandom</backend>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='rng0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </rng>
Apr 14 17:06:10 user nova-compute[71689]:   </devices>
Apr 14 17:06:10 user nova-compute[71689]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 17:06:10 user nova-compute[71689]:     <label>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</label>
Apr 14 17:06:10 user nova-compute[71689]:     <imagelabel>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</imagelabel>
Apr 14 17:06:10 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:10 user nova-compute[71689]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 17:06:10 user nova-compute[71689]:     <label>+64055:+108</label>
Apr 14 17:06:10 user nova-compute[71689]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 17:06:10 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:10 user nova-compute[71689]: </domain>
Apr 14 17:06:10 user nova-compute[71689]:  {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 17:06:10 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully detached device tap01bf74ae-32 from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the persistent domain config.
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] (1/8): Attempting to detach device tap01bf74ae-32 with device alias net1 from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] detach device xml: <interface type="ethernet">
Apr 14 17:06:10 user nova-compute[71689]:   <mac address="fa:16:3e:58:84:4c"/>
Apr 14 17:06:10 user nova-compute[71689]:   <model type="virtio"/>
Apr 14 17:06:10 user nova-compute[71689]:   <mtu size="1442"/>
Apr 14 17:06:10 user nova-compute[71689]:   <target dev="tap01bf74ae-32"/>
Apr 14 17:06:10 user nova-compute[71689]: </interface>
Apr 14 17:06:10 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681491970.3765619, 113dda5c-a61e-423b-86ea-2fe30a113173 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Start waiting for the detach event from libvirt for device tap01bf74ae-32 with device alias net1 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface> {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 17:06:10 user nova-compute[71689]:   <name>instance-00000009</name>
Apr 14 17:06:10 user nova-compute[71689]:   <uuid>113dda5c-a61e-423b-86ea-2fe30a113173</uuid>
Apr 14 17:06:10 user nova-compute[71689]:   <metadata>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:10 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:05:59</nova:creationTime>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:06:10 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:owner>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:owner>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:ports>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:06:10 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:06:10 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:port uuid="01bf74ae-32c2-4241-9a37-abba15fe3de6">
Apr 14 17:06:10 user nova-compute[71689]:       <nova:ip type="fixed" address="10.10.10.115" ipVersion="4"/>
Apr 14 17:06:10 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:ports>
Apr 14 17:06:10 user nova-compute[71689]: </nova:instance>
Apr 14 17:06:10 user nova-compute[71689]:   </metadata>
Apr 14 17:06:10 user nova-compute[71689]:   <memory unit='KiB'>131072</memory>
Apr 14 17:06:10 user nova-compute[71689]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 17:06:10 user nova-compute[71689]:   <vcpu placement='static'>1</vcpu>
Apr 14 17:06:10 user nova-compute[71689]:   <resource>
Apr 14 17:06:10 user nova-compute[71689]:     <partition>/machine</partition>
Apr 14 17:06:10 user nova-compute[71689]:   </resource>
Apr 14 17:06:10 user nova-compute[71689]:   <sysinfo type='smbios'>
Apr 14 17:06:10 user nova-compute[71689]:     <system>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='version'>0.0.0</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='serial'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='uuid'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:10 user nova-compute[71689]:       <entry name='family'>Virtual Machine</entry>
Apr 14 17:06:10 user nova-compute[71689]:     </system>
Apr 14 17:06:10 user nova-compute[71689]:   </sysinfo>
Apr 14 17:06:10 user nova-compute[71689]:   <os>
Apr 14 17:06:10 user nova-compute[71689]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 17:06:10 user nova-compute[71689]:     <boot dev='hd'/>
Apr 14 17:06:10 user nova-compute[71689]:     <smbios mode='sysinfo'/>
Apr 14 17:06:10 user nova-compute[71689]:   </os>
Apr 14 17:06:10 user nova-compute[71689]:   <features>
Apr 14 17:06:10 user nova-compute[71689]:     <acpi/>
Apr 14 17:06:10 user nova-compute[71689]:     <apic/>
Apr 14 17:06:10 user nova-compute[71689]:     <vmcoreinfo state='on'/>
Apr 14 17:06:10 user nova-compute[71689]:   </features>
Apr 14 17:06:10 user nova-compute[71689]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 17:06:10 user nova-compute[71689]:     <model fallback='forbid'>Nehalem</model>
Apr 14 17:06:10 user nova-compute[71689]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 17:06:10 user nova-compute[71689]:     <feature policy='require' name='vme'/>
Apr 14 17:06:10 user nova-compute[71689]:     <feature policy='require' name='x2apic'/>
Apr 14 17:06:10 user nova-compute[71689]:     <feature policy='require' name='hypervisor'/>
Apr 14 17:06:10 user nova-compute[71689]:   </cpu>
Apr 14 17:06:10 user nova-compute[71689]:   <clock offset='utc'>
Apr 14 17:06:10 user nova-compute[71689]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 17:06:10 user nova-compute[71689]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 17:06:10 user nova-compute[71689]:     <timer name='hpet' present='no'/>
Apr 14 17:06:10 user nova-compute[71689]:   </clock>
Apr 14 17:06:10 user nova-compute[71689]:   <on_poweroff>destroy</on_poweroff>
Apr 14 17:06:10 user nova-compute[71689]:   <on_reboot>restart</on_reboot>
Apr 14 17:06:10 user nova-compute[71689]:   <on_crash>destroy</on_crash>
Apr 14 17:06:10 user nova-compute[71689]:   <devices>
Apr 14 17:06:10 user nova-compute[71689]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 17:06:10 user nova-compute[71689]:     <disk type='file' device='disk'>
Apr 14 17:06:10 user nova-compute[71689]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 17:06:10 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk' index='2'/>
Apr 14 17:06:10 user nova-compute[71689]:       <backingStore type='file' index='3'>
Apr 14 17:06:10 user nova-compute[71689]:         <format type='raw'/>
Apr 14 17:06:10 user nova-compute[71689]:         <source file='/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350'/>
Apr 14 17:06:10 user nova-compute[71689]:         <backingStore/>
Apr 14 17:06:10 user nova-compute[71689]:       </backingStore>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='vda' bus='virtio'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='virtio-disk0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </disk>
Apr 14 17:06:10 user nova-compute[71689]:     <disk type='file' device='cdrom'>
Apr 14 17:06:10 user nova-compute[71689]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 17:06:10 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config' index='1'/>
Apr 14 17:06:10 user nova-compute[71689]:       <backingStore/>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='hda' bus='ide'/>
Apr 14 17:06:10 user nova-compute[71689]:       <readonly/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='ide0-0-0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </disk>
Apr 14 17:06:10 user nova-compute[71689]:     <controller type='usb' index='0' model='none'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='usb'/>
Apr 14 17:06:10 user nova-compute[71689]:     </controller>
Apr 14 17:06:10 user nova-compute[71689]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='pci.0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </controller>
Apr 14 17:06:10 user nova-compute[71689]:     <controller type='ide' index='0'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='ide'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 17:06:10 user nova-compute[71689]:     </controller>
Apr 14 17:06:10 user nova-compute[71689]:     <interface type='ethernet'>
Apr 14 17:06:10 user nova-compute[71689]:       <mac address='fa:16:3e:37:3a:79'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target dev='tap34ea1bd9-f0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <model type='virtio'/>
Apr 14 17:06:10 user nova-compute[71689]:       <mtu size='1442'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='net0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </interface>
Apr 14 17:06:10 user nova-compute[71689]:     <serial type='pty'>
Apr 14 17:06:10 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:10 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target type='isa-serial' port='0'>
Apr 14 17:06:10 user nova-compute[71689]:         <model name='isa-serial'/>
Apr 14 17:06:10 user nova-compute[71689]:       </target>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </serial>
Apr 14 17:06:10 user nova-compute[71689]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 17:06:10 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:10 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:10 user nova-compute[71689]:       <target type='serial' port='0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </console>
Apr 14 17:06:10 user nova-compute[71689]:     <input type='mouse' bus='ps2'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='input0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </input>
Apr 14 17:06:10 user nova-compute[71689]:     <input type='keyboard' bus='ps2'>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='input1'/>
Apr 14 17:06:10 user nova-compute[71689]:     </input>
Apr 14 17:06:10 user nova-compute[71689]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 17:06:10 user nova-compute[71689]:       <listen type='address' address='0.0.0.0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </graphics>
Apr 14 17:06:10 user nova-compute[71689]:     <audio id='1' type='none'/>
Apr 14 17:06:10 user nova-compute[71689]:     <video>
Apr 14 17:06:10 user nova-compute[71689]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='video0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </video>
Apr 14 17:06:10 user nova-compute[71689]:     <memballoon model='virtio'>
Apr 14 17:06:10 user nova-compute[71689]:       <stats period='10'/>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='balloon0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </memballoon>
Apr 14 17:06:10 user nova-compute[71689]:     <rng model='virtio'>
Apr 14 17:06:10 user nova-compute[71689]:       <backend model='random'>/dev/urandom</backend>
Apr 14 17:06:10 user nova-compute[71689]:       <alias name='rng0'/>
Apr 14 17:06:10 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 17:06:10 user nova-compute[71689]:     </rng>
Apr 14 17:06:10 user nova-compute[71689]:   </devices>
Apr 14 17:06:10 user nova-compute[71689]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 17:06:10 user nova-compute[71689]:     <label>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</label>
Apr 14 17:06:10 user nova-compute[71689]:     <imagelabel>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</imagelabel>
Apr 14 17:06:10 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:10 user nova-compute[71689]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 17:06:10 user nova-compute[71689]:     <label>+64055:+108</label>
Apr 14 17:06:10 user nova-compute[71689]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 17:06:10 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:10 user nova-compute[71689]: </domain>
Apr 14 17:06:10 user nova-compute[71689]:  {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 17:06:10 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully detached device tap01bf74ae-32 from instance 113dda5c-a61e-423b-86ea-2fe30a113173 from the live domain config.
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG os_vif [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01bf74ae-32, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: INFO os_vif [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32')
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:10 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:06:10</nova:creationTime>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:06:10 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:owner>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:owner>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:10 user nova-compute[71689]:   <nova:ports>
Apr 14 17:06:10 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:06:10 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:06:10 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:10 user nova-compute[71689]:   </nova:ports>
Apr 14 17:06:10 user nova-compute[71689]: </nova:instance>
Apr 14 17:06:10 user nova-compute[71689]:  {{(pid=71689) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 560988160 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-unplugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-unplugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:10 user nova-compute[71689]: WARNING nova.compute.manager [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-unplugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance with vm_state active and task_state None.
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 710934528 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 868220928 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-deleted-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:11 user nova-compute[71689]: INFO nova.compute.manager [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Neutron deleted interface 01bf74ae-32c2-4241-9a37-abba15fe3de6; detaching it from the instance and deleting it from the info cache
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquired lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.objects.instance [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Lazy-loading 'system_metadata' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:11 user nova-compute[71689]: DEBUG nova.objects.instance [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Lazy-loading 'flavor' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Converting VIF {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface> {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 17:06:12 user nova-compute[71689]:   <name>instance-00000009</name>
Apr 14 17:06:12 user nova-compute[71689]:   <uuid>113dda5c-a61e-423b-86ea-2fe30a113173</uuid>
Apr 14 17:06:12 user nova-compute[71689]:   <metadata>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:12 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:06:10</nova:creationTime>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:06:12 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:owner>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:owner>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:ports>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:06:12 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:06:12 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:ports>
Apr 14 17:06:12 user nova-compute[71689]: </nova:instance>
Apr 14 17:06:12 user nova-compute[71689]:   </metadata>
Apr 14 17:06:12 user nova-compute[71689]:   <memory unit='KiB'>131072</memory>
Apr 14 17:06:12 user nova-compute[71689]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 17:06:12 user nova-compute[71689]:   <vcpu placement='static'>1</vcpu>
Apr 14 17:06:12 user nova-compute[71689]:   <resource>
Apr 14 17:06:12 user nova-compute[71689]:     <partition>/machine</partition>
Apr 14 17:06:12 user nova-compute[71689]:   </resource>
Apr 14 17:06:12 user nova-compute[71689]:   <sysinfo type='smbios'>
Apr 14 17:06:12 user nova-compute[71689]:     <system>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='version'>0.0.0</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='serial'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='uuid'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='family'>Virtual Machine</entry>
Apr 14 17:06:12 user nova-compute[71689]:     </system>
Apr 14 17:06:12 user nova-compute[71689]:   </sysinfo>
Apr 14 17:06:12 user nova-compute[71689]:   <os>
Apr 14 17:06:12 user nova-compute[71689]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 17:06:12 user nova-compute[71689]:     <boot dev='hd'/>
Apr 14 17:06:12 user nova-compute[71689]:     <smbios mode='sysinfo'/>
Apr 14 17:06:12 user nova-compute[71689]:   </os>
Apr 14 17:06:12 user nova-compute[71689]:   <features>
Apr 14 17:06:12 user nova-compute[71689]:     <acpi/>
Apr 14 17:06:12 user nova-compute[71689]:     <apic/>
Apr 14 17:06:12 user nova-compute[71689]:     <vmcoreinfo state='on'/>
Apr 14 17:06:12 user nova-compute[71689]:   </features>
Apr 14 17:06:12 user nova-compute[71689]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 17:06:12 user nova-compute[71689]:     <model fallback='forbid'>Nehalem</model>
Apr 14 17:06:12 user nova-compute[71689]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 17:06:12 user nova-compute[71689]:     <feature policy='require' name='vme'/>
Apr 14 17:06:12 user nova-compute[71689]:     <feature policy='require' name='x2apic'/>
Apr 14 17:06:12 user nova-compute[71689]:     <feature policy='require' name='hypervisor'/>
Apr 14 17:06:12 user nova-compute[71689]:   </cpu>
Apr 14 17:06:12 user nova-compute[71689]:   <clock offset='utc'>
Apr 14 17:06:12 user nova-compute[71689]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 17:06:12 user nova-compute[71689]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 17:06:12 user nova-compute[71689]:     <timer name='hpet' present='no'/>
Apr 14 17:06:12 user nova-compute[71689]:   </clock>
Apr 14 17:06:12 user nova-compute[71689]:   <on_poweroff>destroy</on_poweroff>
Apr 14 17:06:12 user nova-compute[71689]:   <on_reboot>restart</on_reboot>
Apr 14 17:06:12 user nova-compute[71689]:   <on_crash>destroy</on_crash>
Apr 14 17:06:12 user nova-compute[71689]:   <devices>
Apr 14 17:06:12 user nova-compute[71689]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 17:06:12 user nova-compute[71689]:     <disk type='file' device='disk'>
Apr 14 17:06:12 user nova-compute[71689]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 17:06:12 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk' index='2'/>
Apr 14 17:06:12 user nova-compute[71689]:       <backingStore type='file' index='3'>
Apr 14 17:06:12 user nova-compute[71689]:         <format type='raw'/>
Apr 14 17:06:12 user nova-compute[71689]:         <source file='/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350'/>
Apr 14 17:06:12 user nova-compute[71689]:         <backingStore/>
Apr 14 17:06:12 user nova-compute[71689]:       </backingStore>
Apr 14 17:06:12 user nova-compute[71689]:       <target dev='vda' bus='virtio'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='virtio-disk0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </disk>
Apr 14 17:06:12 user nova-compute[71689]:     <disk type='file' device='cdrom'>
Apr 14 17:06:12 user nova-compute[71689]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 17:06:12 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config' index='1'/>
Apr 14 17:06:12 user nova-compute[71689]:       <backingStore/>
Apr 14 17:06:12 user nova-compute[71689]:       <target dev='hda' bus='ide'/>
Apr 14 17:06:12 user nova-compute[71689]:       <readonly/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='ide0-0-0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </disk>
Apr 14 17:06:12 user nova-compute[71689]:     <controller type='usb' index='0' model='none'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='usb'/>
Apr 14 17:06:12 user nova-compute[71689]:     </controller>
Apr 14 17:06:12 user nova-compute[71689]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='pci.0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </controller>
Apr 14 17:06:12 user nova-compute[71689]:     <controller type='ide' index='0'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='ide'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 17:06:12 user nova-compute[71689]:     </controller>
Apr 14 17:06:12 user nova-compute[71689]:     <interface type='ethernet'>
Apr 14 17:06:12 user nova-compute[71689]:       <mac address='fa:16:3e:37:3a:79'/>
Apr 14 17:06:12 user nova-compute[71689]:       <target dev='tap34ea1bd9-f0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <model type='virtio'/>
Apr 14 17:06:12 user nova-compute[71689]:       <mtu size='1442'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='net0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </interface>
Apr 14 17:06:12 user nova-compute[71689]:     <serial type='pty'>
Apr 14 17:06:12 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:12 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:12 user nova-compute[71689]:       <target type='isa-serial' port='0'>
Apr 14 17:06:12 user nova-compute[71689]:         <model name='isa-serial'/>
Apr 14 17:06:12 user nova-compute[71689]:       </target>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </serial>
Apr 14 17:06:12 user nova-compute[71689]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 17:06:12 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:12 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:12 user nova-compute[71689]:       <target type='serial' port='0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </console>
Apr 14 17:06:12 user nova-compute[71689]:     <input type='mouse' bus='ps2'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='input0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </input>
Apr 14 17:06:12 user nova-compute[71689]:     <input type='keyboard' bus='ps2'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='input1'/>
Apr 14 17:06:12 user nova-compute[71689]:     </input>
Apr 14 17:06:12 user nova-compute[71689]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 17:06:12 user nova-compute[71689]:       <listen type='address' address='0.0.0.0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </graphics>
Apr 14 17:06:12 user nova-compute[71689]:     <audio id='1' type='none'/>
Apr 14 17:06:12 user nova-compute[71689]:     <video>
Apr 14 17:06:12 user nova-compute[71689]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='video0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </video>
Apr 14 17:06:12 user nova-compute[71689]:     <memballoon model='virtio'>
Apr 14 17:06:12 user nova-compute[71689]:       <stats period='10'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='balloon0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </memballoon>
Apr 14 17:06:12 user nova-compute[71689]:     <rng model='virtio'>
Apr 14 17:06:12 user nova-compute[71689]:       <backend model='random'>/dev/urandom</backend>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='rng0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </rng>
Apr 14 17:06:12 user nova-compute[71689]:   </devices>
Apr 14 17:06:12 user nova-compute[71689]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 17:06:12 user nova-compute[71689]:     <label>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</label>
Apr 14 17:06:12 user nova-compute[71689]:     <imagelabel>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</imagelabel>
Apr 14 17:06:12 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:12 user nova-compute[71689]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 17:06:12 user nova-compute[71689]:     <label>+64055:+108</label>
Apr 14 17:06:12 user nova-compute[71689]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 17:06:12 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:12 user nova-compute[71689]: </domain>
Apr 14 17:06:12 user nova-compute[71689]:  {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface> {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:84:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap01bf74ae-32"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 17:06:12 user nova-compute[71689]:   <name>instance-00000009</name>
Apr 14 17:06:12 user nova-compute[71689]:   <uuid>113dda5c-a61e-423b-86ea-2fe30a113173</uuid>
Apr 14 17:06:12 user nova-compute[71689]:   <metadata>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:12 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:06:10</nova:creationTime>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:06:12 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:owner>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:owner>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:ports>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:06:12 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:06:12 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:ports>
Apr 14 17:06:12 user nova-compute[71689]: </nova:instance>
Apr 14 17:06:12 user nova-compute[71689]:   </metadata>
Apr 14 17:06:12 user nova-compute[71689]:   <memory unit='KiB'>131072</memory>
Apr 14 17:06:12 user nova-compute[71689]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 17:06:12 user nova-compute[71689]:   <vcpu placement='static'>1</vcpu>
Apr 14 17:06:12 user nova-compute[71689]:   <resource>
Apr 14 17:06:12 user nova-compute[71689]:     <partition>/machine</partition>
Apr 14 17:06:12 user nova-compute[71689]:   </resource>
Apr 14 17:06:12 user nova-compute[71689]:   <sysinfo type='smbios'>
Apr 14 17:06:12 user nova-compute[71689]:     <system>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='version'>0.0.0</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='serial'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='uuid'>113dda5c-a61e-423b-86ea-2fe30a113173</entry>
Apr 14 17:06:12 user nova-compute[71689]:       <entry name='family'>Virtual Machine</entry>
Apr 14 17:06:12 user nova-compute[71689]:     </system>
Apr 14 17:06:12 user nova-compute[71689]:   </sysinfo>
Apr 14 17:06:12 user nova-compute[71689]:   <os>
Apr 14 17:06:12 user nova-compute[71689]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 17:06:12 user nova-compute[71689]:     <boot dev='hd'/>
Apr 14 17:06:12 user nova-compute[71689]:     <smbios mode='sysinfo'/>
Apr 14 17:06:12 user nova-compute[71689]:   </os>
Apr 14 17:06:12 user nova-compute[71689]:   <features>
Apr 14 17:06:12 user nova-compute[71689]:     <acpi/>
Apr 14 17:06:12 user nova-compute[71689]:     <apic/>
Apr 14 17:06:12 user nova-compute[71689]:     <vmcoreinfo state='on'/>
Apr 14 17:06:12 user nova-compute[71689]:   </features>
Apr 14 17:06:12 user nova-compute[71689]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 17:06:12 user nova-compute[71689]:     <model fallback='forbid'>Nehalem</model>
Apr 14 17:06:12 user nova-compute[71689]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 17:06:12 user nova-compute[71689]:     <feature policy='require' name='vme'/>
Apr 14 17:06:12 user nova-compute[71689]:     <feature policy='require' name='x2apic'/>
Apr 14 17:06:12 user nova-compute[71689]:     <feature policy='require' name='hypervisor'/>
Apr 14 17:06:12 user nova-compute[71689]:   </cpu>
Apr 14 17:06:12 user nova-compute[71689]:   <clock offset='utc'>
Apr 14 17:06:12 user nova-compute[71689]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 17:06:12 user nova-compute[71689]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 17:06:12 user nova-compute[71689]:     <timer name='hpet' present='no'/>
Apr 14 17:06:12 user nova-compute[71689]:   </clock>
Apr 14 17:06:12 user nova-compute[71689]:   <on_poweroff>destroy</on_poweroff>
Apr 14 17:06:12 user nova-compute[71689]:   <on_reboot>restart</on_reboot>
Apr 14 17:06:12 user nova-compute[71689]:   <on_crash>destroy</on_crash>
Apr 14 17:06:12 user nova-compute[71689]:   <devices>
Apr 14 17:06:12 user nova-compute[71689]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 17:06:12 user nova-compute[71689]:     <disk type='file' device='disk'>
Apr 14 17:06:12 user nova-compute[71689]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 17:06:12 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk' index='2'/>
Apr 14 17:06:12 user nova-compute[71689]:       <backingStore type='file' index='3'>
Apr 14 17:06:12 user nova-compute[71689]:         <format type='raw'/>
Apr 14 17:06:12 user nova-compute[71689]:         <source file='/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350'/>
Apr 14 17:06:12 user nova-compute[71689]:         <backingStore/>
Apr 14 17:06:12 user nova-compute[71689]:       </backingStore>
Apr 14 17:06:12 user nova-compute[71689]:       <target dev='vda' bus='virtio'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='virtio-disk0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </disk>
Apr 14 17:06:12 user nova-compute[71689]:     <disk type='file' device='cdrom'>
Apr 14 17:06:12 user nova-compute[71689]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 17:06:12 user nova-compute[71689]:       <source file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk.config' index='1'/>
Apr 14 17:06:12 user nova-compute[71689]:       <backingStore/>
Apr 14 17:06:12 user nova-compute[71689]:       <target dev='hda' bus='ide'/>
Apr 14 17:06:12 user nova-compute[71689]:       <readonly/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='ide0-0-0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </disk>
Apr 14 17:06:12 user nova-compute[71689]:     <controller type='usb' index='0' model='none'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='usb'/>
Apr 14 17:06:12 user nova-compute[71689]:     </controller>
Apr 14 17:06:12 user nova-compute[71689]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='pci.0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </controller>
Apr 14 17:06:12 user nova-compute[71689]:     <controller type='ide' index='0'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='ide'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 17:06:12 user nova-compute[71689]:     </controller>
Apr 14 17:06:12 user nova-compute[71689]:     <interface type='ethernet'>
Apr 14 17:06:12 user nova-compute[71689]:       <mac address='fa:16:3e:37:3a:79'/>
Apr 14 17:06:12 user nova-compute[71689]:       <target dev='tap34ea1bd9-f0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <model type='virtio'/>
Apr 14 17:06:12 user nova-compute[71689]:       <mtu size='1442'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='net0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </interface>
Apr 14 17:06:12 user nova-compute[71689]:     <serial type='pty'>
Apr 14 17:06:12 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:12 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:12 user nova-compute[71689]:       <target type='isa-serial' port='0'>
Apr 14 17:06:12 user nova-compute[71689]:         <model name='isa-serial'/>
Apr 14 17:06:12 user nova-compute[71689]:       </target>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </serial>
Apr 14 17:06:12 user nova-compute[71689]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 17:06:12 user nova-compute[71689]:       <source path='/dev/pts/8'/>
Apr 14 17:06:12 user nova-compute[71689]:       <log file='/opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/console.log' append='off'/>
Apr 14 17:06:12 user nova-compute[71689]:       <target type='serial' port='0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='serial0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </console>
Apr 14 17:06:12 user nova-compute[71689]:     <input type='mouse' bus='ps2'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='input0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </input>
Apr 14 17:06:12 user nova-compute[71689]:     <input type='keyboard' bus='ps2'>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='input1'/>
Apr 14 17:06:12 user nova-compute[71689]:     </input>
Apr 14 17:06:12 user nova-compute[71689]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 17:06:12 user nova-compute[71689]:       <listen type='address' address='0.0.0.0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </graphics>
Apr 14 17:06:12 user nova-compute[71689]:     <audio id='1' type='none'/>
Apr 14 17:06:12 user nova-compute[71689]:     <video>
Apr 14 17:06:12 user nova-compute[71689]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='video0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </video>
Apr 14 17:06:12 user nova-compute[71689]:     <memballoon model='virtio'>
Apr 14 17:06:12 user nova-compute[71689]:       <stats period='10'/>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='balloon0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </memballoon>
Apr 14 17:06:12 user nova-compute[71689]:     <rng model='virtio'>
Apr 14 17:06:12 user nova-compute[71689]:       <backend model='random'>/dev/urandom</backend>
Apr 14 17:06:12 user nova-compute[71689]:       <alias name='rng0'/>
Apr 14 17:06:12 user nova-compute[71689]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 17:06:12 user nova-compute[71689]:     </rng>
Apr 14 17:06:12 user nova-compute[71689]:   </devices>
Apr 14 17:06:12 user nova-compute[71689]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 17:06:12 user nova-compute[71689]:     <label>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</label>
Apr 14 17:06:12 user nova-compute[71689]:     <imagelabel>libvirt-113dda5c-a61e-423b-86ea-2fe30a113173</imagelabel>
Apr 14 17:06:12 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:12 user nova-compute[71689]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 17:06:12 user nova-compute[71689]:     <label>+64055:+108</label>
Apr 14 17:06:12 user nova-compute[71689]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 17:06:12 user nova-compute[71689]:   </seclabel>
Apr 14 17:06:12 user nova-compute[71689]: </domain>
Apr 14 17:06:12 user nova-compute[71689]:  {{(pid=71689) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 17:06:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Detaching interface fa:16:3e:58:84:4c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap01bf74ae-32' not found.
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Converting VIF {"id": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "address": "fa:16:3e:58:84:4c", "network": {"id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1536799908", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf74ae-32", "ovs_interfaceid": "01bf74ae-32c2-4241-9a37-abba15fe3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_vif [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01bf74ae-32, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:06:12 user nova-compute[71689]: INFO os_vif [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:84:4c,bridge_name='br-int',has_traffic_filtering=True,id=01bf74ae-32c2-4241-9a37-abba15fe3de6,network=Network(fc5fc1b6-6eb8-4e95-8f50-5744bdc58393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf74ae-32')
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:12 user nova-compute[71689]:   <nova:package version="0.0.0"/>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:name>tempest-device-tagging-server-1042660194</nova:name>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:creationTime>2023-04-14 17:06:12</nova:creationTime>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:flavor name="m1.nano">
Apr 14 17:06:12 user nova-compute[71689]:     <nova:memory>128</nova:memory>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:disk>1</nova:disk>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:swap>0</nova:swap>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:flavor>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:owner>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:user uuid="c31588acbcc345519934f4c3a395b0c5">tempest-TaggedAttachmentsTest-1726748799-project-member</nova:user>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:project uuid="924256f7ef8c4a5a832a87d1c198c50a">tempest-TaggedAttachmentsTest-1726748799</nova:project>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:owner>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:12 user nova-compute[71689]:   <nova:ports>
Apr 14 17:06:12 user nova-compute[71689]:     <nova:port uuid="34ea1bd9-f010-4073-bf8d-351b0e85ceeb">
Apr 14 17:06:12 user nova-compute[71689]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 17:06:12 user nova-compute[71689]:     </nova:port>
Apr 14 17:06:12 user nova-compute[71689]:   </nova:ports>
Apr 14 17:06:12 user nova-compute[71689]: </nova:instance>
Apr 14 17:06:12 user nova-compute[71689]:  {{(pid=71689) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 1008730112 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.network.neutron [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [{"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Releasing lock "refresh_cache-113dda5c-a61e-423b-86ea-2fe30a113173" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "interface-113dda5c-a61e-423b-86ea-2fe30a113173-01bf74ae-32c2-4241-9a37-abba15fe3de6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.490s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:12 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d501d4f-718b-4a8b-a4cd-99061fa5309c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:12 user nova-compute[71689]: No targets found.
Apr 14 17:06:12 user nova-compute[71689]: iSNS:
Apr 14 17:06:12 user nova-compute[71689]: No targets found.
Apr 14 17:06:12 user nova-compute[71689]: STATIC:
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:12 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:12 user nova-compute[71689]: No targets found.
Apr 14 17:06:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:12 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:12 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:12 user nova-compute[71689]: WARNING nova.compute.manager [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-plugged-01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance with vm_state active and task_state None.
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf336b5-2533-45da-8559-bab4e4d56fae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce9509-7cba-40e6-acbd-b10780a23994]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:12 user nova-compute[71689]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c592a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b902d72-6941-4649-9495-e451d545afcb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf69d67-67f2-4a21-97bd-3b352c6797dd]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beeed9f-27c4-4fd1-b88c-e68923e63271]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f1aee-cc04-4937-85ea-b7955ebb7162]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958a56e-686f-4872-828d-2bfacf463cfc]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce4bbf5-a5a5-4800-b246-3baac7af3c2f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]
Apr 14 17:06:13 user nova-compute[71689]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f1947-f247-4ef8-a322-3b4633ff8b7b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] <== disconnect_volume: return (334ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQXHseO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'f53cfe1f-c915-4a74-8512-84a97147f1d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'serial'} {{(pid=71689) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] swap_volume: removing Cinder connection for volume 3efe6a50-62c4-4eae-a012-2d4a71faa73f {{(pid=71689) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] swap_volume: Updating volume 3efe6a50-62c4-4eae-a012-2d4a71faa73f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "oZQXHseO", "auth_password": "YCokBtvyd3Q1Aa", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "fa07d38e-7ab2-4439-b17f-e6a139923ab3"}, "status": "reserved", "instance": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "attached_at": "", "detached_at": "", "volume_id": "fa07d38e-7ab2-4439-b17f-e6a139923ab3", "serial": "fa07d38e-7ab2-4439-b17f-e6a139923ab3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'no_device': None, 'attachment_id': '00aea8a7-80ae-4066-84cc-f798fe4dc326'} {{(pid=71689) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 17:06:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.530s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG os_brick.utils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c292291-d579-40a2-9a9e-3a9347626cf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec316895-4bf3-43be-aecf-a29a5ced490c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3438735-05ab-44d5-afa7-ce410f250572]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9199810c-a3ff-4ed3-939c-bd07e742de6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:06:15 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:06:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d9218-1070-496d-b5e4-271b32780a8b]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG os_brick.utils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:15 user nova-compute[71689]: INFO nova.compute.manager [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Swapping volume fa07d38e-7ab2-4439-b17f-e6a139923ab3 for 3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:19 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:06:19 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=26.537124633789062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c0488788-7b88-4c48-9fcd-02640c09feb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 113dda5c-a61e-423b-86ea-2fe30a113173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d8483240-2bf3-42cd-bf10-5d8231303e58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7465a41f-c916-4cca-8084-7c646409007d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:06:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f53cfe1f-c915-4a74-8512-84a97147f1d1', 'attached_at': '', 'detached_at': '', 'volume_id': '3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'serial': '3efe6a50-62c4-4eae-a012-2d4a71faa73f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQXHseO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3'}, 'status': 'reserved', 'instance': 'f53cfe1f-c915-4a74-8512-84a97147f1d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'serial'} {{(pid=71689) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:20 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:20 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:20 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a9bac-f4b0-4b33-87ac-3446a7f3b727]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:06:20 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2673ce-e7e2-4562-9623-9289dab8283a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f] added
Apr 14 17:06:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcda1fd-daa7-44b1-bd30-f854c471acea]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[258c367c-c0a2-4654-9397-7237b401f3a8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCmeBxcy {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCmeBxcy" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0ba12-6d1d-4bcd-928d-5acdaefb181b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCmeBxcy'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2de2cbd-0ab5-4d18-a8d7-d5c7a1286d43]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[137902b2-2845-49f4-bb79-f7e105b87f4e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc38e7b-7033-4804-a646-3ac691ddd916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]
Apr 14 17:06:20 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a64588c-11ce-4478-a8ff-3f8f1465313b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[daac7654-f88a-4c01-9bed-56665e68c2b3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:20 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82c8343-f413-4c42-a06b-00442487a114]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:06:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681491966.0957155, 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:06:21 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] VM Stopped (Lifecycle Event)
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-62db38fb-0740-4b6f-a129-32f37f7e2c81 None None] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26137323832613330', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137323832613330', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.objects.instance [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lazy-loading 'flavor' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 3145728 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 106954752 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 266338304 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-changed-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing instance network info cache due to event network-changed-908df516-5b0a-42b8-82d4-1f36c0dbcdc0. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Acquiring lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Acquired lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Refreshing network info cache for port 908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 412090368 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updated VIF entry in instance network info cache for port 908df516-5b0a-42b8-82d4-1f36c0dbcdc0. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [{"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Releasing lock "refresh_cache-d8483240-2bf3-42cd-bf10-5d8231303e58" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:06:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 598736896 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 772800512 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 935329792 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:25 user nova-compute[71689]: INFO nova.compute.manager [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Terminating instance
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQXHseO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'fa07d38e-7ab2-4439-b17f-e6a139923ab3': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:25 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0bb152-f441-4661-8f3c-e5e0bb601817]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:25 user nova-compute[71689]: No targets found.
Apr 14 17:06:25 user nova-compute[71689]: iSNS:
Apr 14 17:06:25 user nova-compute[71689]: No targets found.
Apr 14 17:06:25 user nova-compute[71689]: STATIC:
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:25 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:25 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:25 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:25 user nova-compute[71689]: No targets found.
Apr 14 17:06:25 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:25 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:25 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd26bd-f5dc-4ac3-bb56-9f4b655baebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b57dd-952a-4493-89d6-c744e8336b75]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:25 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:25 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:25 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c328550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3'): ({'sdi'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Removing single pathed devices sdi {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2167a4-d7cb-4199-9906-d6a29dc2a2cb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda907bc-cbaf-4c27-b8c3-c42a3686ad64]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Flushing IO for device /dev/sdi {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a4cf92-9784-412e-b7f9-12ebd3bc2eaa]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[55582fc7-ce05-4268-8e38-6feca78c5776]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] SCSI volumes sdi have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9586ec-2d3f-40da-9209-8f76fe2b9461]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.126s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f127459-a610-47d7-9a1f-2ffa269bff44]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260]
Apr 14 17:06:25 user nova-compute[71689]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:25 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa07d38e-7ab2-4439-b17f-e6a139923ab3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5995f4b8-351c-4014-81f7-2939ff1c461e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] <== disconnect_volume: return (443ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f53cfe1f-c915-4a74-8512-84a97147f1d1', 'attached_at': '', 'detached_at': '', 'volume_id': '3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'serial'} {{(pid=71689) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] swap_volume: removing Cinder connection for volume fa07d38e-7ab2-4439-b17f-e6a139923ab3 {{(pid=71689) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Instance destroyed successfully.
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lazy-loading 'resources' on Instance uuid d8483240-2bf3-42cd-bf10-5d8231303e58 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908df516-5b, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:96:74,bridge_name='br-int',has_traffic_filtering=True,id=908df516-5b0a-42b8-82d4-1f36c0dbcdc0,network=Network(64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908df516-5b')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd61ec716-2b, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9a:9a,bridge_name='br-int',has_traffic_filtering=True,id=d61ec716-2b00-4426-b014-fb1d07515463,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd61ec716-2b')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7320798-2a, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:4f:ad,bridge_name='br-int',has_traffic_filtering=True,id=f7320798-2ab9-411c-98dd-2f0006b0c3e2,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7320798-2a')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b216986-dc, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] swap_volume: Updating volume fa07d38e-7ab2-4439-b17f-e6a139923ab3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bCmeBxcy", "auth_password": "rfuL0QYOlXSqZK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "3efe6a50-62c4-4eae-a012-2d4a71faa73f"}, "status": "reserved", "instance": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "attached_at": "", "detached_at": "", "volume_id": "3efe6a50-62c4-4eae-a012-2d4a71faa73f", "serial": "3efe6a50-62c4-4eae-a012-2d4a71faa73f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'no_device': None, 'attachment_id': '1746b8be-f8c6-4490-8416-4a44fcb2e004'} {{(pid=71689) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=3b216986-dcbd-4502-8655-92a598ad85db,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b216986-dc')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc33eac6d-3c, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.418s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:71:b3,bridge_name='br-int',has_traffic_filtering=True,id=c33eac6d-3cd4-491c-b151-abeb733a0a09,network=Network(71794092-e6e0-49a2-a984-cf885efb7f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33eac6d-3c')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "b14ce4b0-a632-4f21-b582-8aef000caf49", "address": "fa:16:3e:17:1e:b7", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ce4b0-a6", "ovs_interfaceid": "b14ce4b0-a632-4f21-b582-8aef000caf49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14ce4b0-a6, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:1e:b7,bridge_name='br-int',has_traffic_filtering=True,id=b14ce4b0-a632-4f21-b582-8aef000caf49,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ce4b0-a6')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-12887603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-12887603',id=10,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw==',key_name='tempest-keypair-547297741',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0706fb42134445cf914a9a00b1042c01',ramdisk_id='',reservation_id='r-sntkpabc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-293729122',owner_user_name='tempest-TaggedBootDevicesTest-293729122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='029c39b7ada54f7b9cb106f054ec8a0c',uuid=d8483240-2bf3-42cd-bf10-5d8231303e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converting VIF {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda304e0f-68, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:27 user nova-compute[71689]: INFO os_vif [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fb:cb,bridge_name='br-int',has_traffic_filtering=True,id=da304e0f-68cc-40fd-a4f9-1175ce2c3ad3,network=Network(9a91c7ee-7ec6-4e2c-9da7-857df3cf273e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda304e0f-68')
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgvWCKaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:27 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: WARNING nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance with vm_state active and task_state deleting.
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-d61ec716-2b00-4426-b014-fb1d07515463 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: WARNING nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-d61ec716-2b00-4426-b014-fb1d07515463 for instance with vm_state active and task_state deleting.
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-3b216986-dcbd-4502-8655-92a598ad85db for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: WARNING nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-3b216986-dcbd-4502-8655-92a598ad85db for instance with vm_state active and task_state deleting.
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:27 user nova-compute[71689]: WARNING nova.compute.manager [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance with vm_state active and task_state deleting.
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f37c8-a2d7-45a1-aea8-7a0a1e69ef8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:27 user nova-compute[71689]: No targets found.
Apr 14 17:06:27 user nova-compute[71689]: iSNS:
Apr 14 17:06:27 user nova-compute[71689]: No targets found.
Apr 14 17:06:27 user nova-compute[71689]: STATIC:
Apr 14 17:06:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:06:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2
Apr 14 17:06:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:27 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:27 user nova-compute[71689]: No targets found.
Apr 14 17:06:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:27 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:27 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb33d0a-0849-4eba-9b8d-2476c3f764b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee18a20-d99e-459a-8286-476b34092c2f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:27 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b5945ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2915e-9283-4efb-8218-b235779b7f79]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd13fb-3e68-49ab-af37-19da10449627]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e444fc-8e20-45e4-a960-b2bcf52d103e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[222226ce-06b0-49bd-9351-2c4933e4ffa8]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaedc953-b452-4cf9-9252-3498a9b5730f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:28 user nova-compute[71689]: WARNING nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance with vm_state active and task_state deleting.
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-b14ce4b0-a632-4f21-b582-8aef000caf49 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:28 user nova-compute[71689]: WARNING nova.compute.manager [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-b14ce4b0-a632-4f21-b582-8aef000caf49 for instance with vm_state active and task_state deleting.
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0cb20c-79bc-4682-ab69-83621e7b7841]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260]
Apr 14 17:06:28 user nova-compute[71689]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a2163e-cfca-4043-8f58-3bd6fb74c8f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc4c325-7d25-4b34-9859-24725fef737a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== disconnect_volume: return (378ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBCtpGTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:28 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed9e332-8eb7-4bde-ac1f-3296257badcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:28 user nova-compute[71689]: No targets found.
Apr 14 17:06:28 user nova-compute[71689]: iSNS:
Apr 14 17:06:28 user nova-compute[71689]: No targets found.
Apr 14 17:06:28 user nova-compute[71689]: STATIC:
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:28 user nova-compute[71689]: No targets found.
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:28 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:28 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f812af-c066-470b-aa1d-272a256f456d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[767135e4-c4a7-47cd-b005-fdbad78960c1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4e09c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5639a613-7b0d-4293-89ab-3909650a34a7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7308c26e-0acf-4ce4-a5ec-0d3d6f4218e6]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[12718e6f-81fd-49a9-ba56-169d8eb44609]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af8c503-4bfd-488c-a2c8-a5deb71077d6]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[429a06da-b380-4dd0-b1ad-c5b19bf826c9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458875e-097d-49e0-9b99-4fb8dea3a3ad]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260]
Apr 14 17:06:28 user nova-compute[71689]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4fadca-3048-4c38-9134-4fc24981f87c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e5b3f7-0f70-41ac-9aa6-73a2eaa10928]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== disconnect_volume: return (328ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPGydwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:28 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2aad8a-a8bd-49b4-ad47-e74b7994ee76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:28 user nova-compute[71689]: No targets found.
Apr 14 17:06:28 user nova-compute[71689]: iSNS:
Apr 14 17:06:28 user nova-compute[71689]: No targets found.
Apr 14 17:06:28 user nova-compute[71689]: STATIC:
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:28 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:28 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:28 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:28 user nova-compute[71689]: No targets found.
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:28 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:28 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba100ba2-00e4-48b8-82d2-aa1181b4a526]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d281c21-3b2f-4c73-a2e9-e6b04c7133d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:28 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b59306b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[308ed396-975c-468c-8cb5-281e4f18920f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c076e560-9577-4d88-b702-d520e2a31d44]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b47d22-c8ac-4f2a-a5c3-c838510457f6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:28 user nova-compute[71689]: INFO nova.compute.manager [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Detaching volume 3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b147b-f5f7-4080-af6c-c4e4851f5165]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[922bd147-ff38-4dd6-b0ba-6e54f436087a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: INFO nova.virt.block_device [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Attempting to driver detach volume 3efe6a50-62c4-4eae-a012-2d4a71faa73f from mountpoint /dev/vdb
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Attempting to detach device vdb from instance f53cfe1f-c915-4a74-8512-84a97147f1d1 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:06:28 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:28 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:06:28 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:06:28 user nova-compute[71689]:   <serial>3efe6a50-62c4-4eae-a012-2d4a71faa73f</serial>
Apr 14 17:06:28 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:06:28 user nova-compute[71689]: </disk>
Apr 14 17:06:28 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:28 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Successfully detached device vdb from instance f53cfe1f-c915-4a74-8512-84a97147f1d1 from the persistent domain config.
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f53cfe1f-c915-4a74-8512-84a97147f1d1 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:06:28 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:06:28 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:06:28 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:06:28 user nova-compute[71689]:   <serial>3efe6a50-62c4-4eae-a012-2d4a71faa73f</serial>
Apr 14 17:06:28 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:06:28 user nova-compute[71689]: </disk>
Apr 14 17:06:28 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49e000-2c74-434f-aec8-80ca9a7a4ba5]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260]
Apr 14 17:06:28 user nova-compute[71689]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0558a5b-2574-42f0-9f57-af61d85365f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3a1aa-2b12-4744-9624-4bc823beed3b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] <== disconnect_volume: return (335ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:28 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Deleting instance files /opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58_del
Apr 14 17:06:28 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Deletion of /opt/stack/data/nova/instances/d8483240-2bf3-42cd-bf10-5d8231303e58_del complete
Apr 14 17:06:28 user nova-compute[71689]: INFO nova.compute.manager [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Took 3.50 seconds to destroy the instance on the hypervisor.
Apr 14 17:06:28 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:06:28 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681491989.1706905, f53cfe1f-c915-4a74-8512-84a97147f1d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:06:29 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Successfully detached device vdb from instance f53cfe1f-c915-4a74-8512-84a97147f1d1 from the live domain config.
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCmeBxcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '3efe6a50-62c4-4eae-a012-2d4a71faa73f': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:06:29 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24514c-ff4a-47a3-a666-7ec676de1eda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:06:29 user nova-compute[71689]: No targets found.
Apr 14 17:06:29 user nova-compute[71689]: iSNS:
Apr 14 17:06:29 user nova-compute[71689]: No targets found.
Apr 14 17:06:29 user nova-compute[71689]: STATIC:
Apr 14 17:06:29 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:06:29 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:29 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:29 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:06:29 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:29 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:29 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f
Apr 14 17:06:29 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:06:29 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:06:29 user nova-compute[71689]: FIRMWARE:
Apr 14 17:06:29 user nova-compute[71689]: No targets found.
Apr 14 17:06:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:06:29 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:06:29 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb56f0be-e486-4862-ba9f-c1670985fbc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d27df-399a-4d84-a8aa-1884c70bc7ee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:29 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:29 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f (non-flash)
Apr 14 17:06:29 user nova-compute[71689]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:06:29 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:06:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c354160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c846448b-c118-4b1b-bdeb-10b326ac534c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9edc2e-692d-4ec9-948e-238490938d95]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[495dea90-e9d1-4005-9e46-6be0c57e55a3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8bb7c8-ee5d-413b-a004-b6ac7935a493]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2021e82d-aac2-44fb-85ef-590d57ba5bde]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff9cc1-5398-4fb2-8bc8-edfde8cefa50]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260]
Apr 14 17:06:29 user nova-compute[71689]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f, portal: 172.16.0.220,3260] successful.
Apr 14 17:06:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efe6a50-62c4-4eae-a012-2d4a71faa73f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7113a2fa-c76f-4e69-8b73-cd446b0ce3b3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] <== disconnect_volume: return (292ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-unplugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-unplugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Acquiring lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] No waiting events found dispatching network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:29 user nova-compute[71689]: WARNING nova.compute.manager [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received unexpected event network-vif-plugged-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance with vm_state active and task_state deleting.
Apr 14 17:06:30 user nova-compute[71689]: DEBUG nova.objects.instance [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'flavor' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-deleted-b14ce4b0-a632-4f21-b582-8aef000caf49 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:31 user nova-compute[71689]: INFO nova.compute.manager [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Neutron deleted interface b14ce4b0-a632-4f21-b582-8aef000caf49; detaching it from the instance and deleting it from the info cache
Apr 14 17:06:31 user nova-compute[71689]: DEBUG nova.network.neutron [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [{"id": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "address": "fa:16:3e:3b:96:74", "network": {"id": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-413165773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908df516-5b", "ovs_interfaceid": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d61ec716-2b00-4426-b014-fb1d07515463", "address": "fa:16:3e:fe:9a:9a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61ec716-2b", "ovs_interfaceid": "d61ec716-2b00-4426-b014-fb1d07515463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "address": "fa:16:3e:cb:4f:ad", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7320798-2a", "ovs_interfaceid": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b216986-dcbd-4502-8655-92a598ad85db", "address": "fa:16:3e:ce:81:1a", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b216986-dc", "ovs_interfaceid": "3b216986-dcbd-4502-8655-92a598ad85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "address": "fa:16:3e:aa:71:b3", "network": {"id": "71794092-e6e0-49a2-a984-cf885efb7f87", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061793748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33eac6d-3c", "ovs_interfaceid": "c33eac6d-3cd4-491c-b151-abeb733a0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "address": "fa:16:3e:22:fb:cb", "network": {"id": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "bridge": "br-int", "label": "tempest-device-tagging-net2-630116497", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0706fb42134445cf914a9a00b1042c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda304e0f-68", "ovs_interfaceid": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Detach interface failed, port_id=b14ce4b0-a632-4f21-b582-8aef000caf49, reason: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:06:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:33 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:33 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Took 4.33 seconds to deallocate network for instance.
Apr 14 17:06:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-deleted-908df516-5b0a-42b8-82d4-1f36c0dbcdc0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-deleted-3b216986-dcbd-4502-8655-92a598ad85db {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-deleted-da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Received event network-vif-deleted-c33eac6d-3cd4-491c-b151-abeb733a0a09 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:35 user nova-compute[71689]: INFO nova.compute.manager [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Took 2.74 seconds to detach 3 volumes for instance.
Apr 14 17:06:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:36 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:06:36 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:06:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:36 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Deleted allocations for instance d8483240-2bf3-42cd-bf10-5d8231303e58
Apr 14 17:06:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "d8483240-2bf3-42cd-bf10-5d8231303e58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.225s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:42 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681491987.2905915, d8483240-2bf3-42cd-bf10-5d8231303e58 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:06:42 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] VM Stopped (Lifecycle Event)
Apr 14 17:06:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cedb0def-3c5e-417c-8f4e-7090e0ee98b3 None None] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:06:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:06:47 user nova-compute[71689]: INFO nova.compute.claims [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Claim successful on node user
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:06:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.policy [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:06:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Creating image(s)
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "/opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "/opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk 1073741824" returned: 0 in 0.050s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Cannot resize image /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'migration_context' on Instance uuid 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Ensure instance console log exists: /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Successfully created port: 179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Successfully updated port: 179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "refresh_cache-8c51fc1f-dcf6-4c42-8a4f-4b489c270895" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquired lock "refresh_cache-8c51fc1f-dcf6-4c42-8a4f-4b489c270895" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received event network-changed-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Refreshing instance network info cache due to event network-changed-179579bb-9a96-4128-bdc5-35cbeca29ff5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Acquiring lock "refresh_cache-8c51fc1f-dcf6-4c42-8a4f-4b489c270895" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Updating instance_info_cache with network_info: [{"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Releasing lock "refresh_cache-8c51fc1f-dcf6-4c42-8a4f-4b489c270895" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Instance network_info: |[{"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Acquired lock "refresh_cache-8c51fc1f-dcf6-4c42-8a4f-4b489c270895" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.neutron [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Refreshing network info cache for port 179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Start _get_guest_xml network_info=[{"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:06:49 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:06:49 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1952305466',display_name='tempest-VolumesAdminNegativeTest-server-1952305466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1952305466',id=13,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c8f41946e544d0c93cbceb3d03e50a5',ramdisk_id='',reservation_id='r-dmhf42gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2070911352',owner_user_name='tempest-VolumesAdminNegativeTest-2070911352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:06:48Z,user_data=None,user_id='01d0e8ec192748edbe2576ef1c1e1cb5',uuid=8c51fc1f-dcf6-4c42-8a4f-4b489c270895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converting VIF {"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:06:49 user nova-compute[71689]:   <uuid>8c51fc1f-dcf6-4c42-8a4f-4b489c270895</uuid>
Apr 14 17:06:49 user nova-compute[71689]:   <name>instance-0000000d</name>
Apr 14 17:06:49 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:06:49 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:06:49 user nova-compute[71689]:   <metadata>
Apr 14 17:06:49 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:06:49 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:06:49 user nova-compute[71689]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1952305466</nova:name>
Apr 14 17:06:49 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:06:49</nova:creationTime>
Apr 14 17:06:49 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:06:49 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:06:49 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:06:49 user nova-compute[71689]:       <nova:owner>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:user uuid="01d0e8ec192748edbe2576ef1c1e1cb5">tempest-VolumesAdminNegativeTest-2070911352-project-member</nova:user>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:project uuid="5c8f41946e544d0c93cbceb3d03e50a5">tempest-VolumesAdminNegativeTest-2070911352</nova:project>
Apr 14 17:06:49 user nova-compute[71689]:       </nova:owner>
Apr 14 17:06:49 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:06:49 user nova-compute[71689]:       <nova:ports>
Apr 14 17:06:49 user nova-compute[71689]:         <nova:port uuid="179579bb-9a96-4128-bdc5-35cbeca29ff5">
Apr 14 17:06:49 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:06:49 user nova-compute[71689]:         </nova:port>
Apr 14 17:06:49 user nova-compute[71689]:       </nova:ports>
Apr 14 17:06:49 user nova-compute[71689]:     </nova:instance>
Apr 14 17:06:49 user nova-compute[71689]:   </metadata>
Apr 14 17:06:49 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:06:49 user nova-compute[71689]:     <system>
Apr 14 17:06:49 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:06:49 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:06:49 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:06:49 user nova-compute[71689]:       <entry name="serial">8c51fc1f-dcf6-4c42-8a4f-4b489c270895</entry>
Apr 14 17:06:49 user nova-compute[71689]:       <entry name="uuid">8c51fc1f-dcf6-4c42-8a4f-4b489c270895</entry>
Apr 14 17:06:49 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:06:49 user nova-compute[71689]:     </system>
Apr 14 17:06:49 user nova-compute[71689]:   </sysinfo>
Apr 14 17:06:49 user nova-compute[71689]:   <os>
Apr 14 17:06:49 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:06:49 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:06:49 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:06:49 user nova-compute[71689]:   </os>
Apr 14 17:06:49 user nova-compute[71689]:   <features>
Apr 14 17:06:49 user nova-compute[71689]:     <acpi/>
Apr 14 17:06:49 user nova-compute[71689]:     <apic/>
Apr 14 17:06:49 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:06:49 user nova-compute[71689]:   </features>
Apr 14 17:06:49 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:06:49 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:06:49 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:06:49 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:06:49 user nova-compute[71689]:   </clock>
Apr 14 17:06:49 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:06:49 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:06:49 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:06:49 user nova-compute[71689]:   </cpu>
Apr 14 17:06:49 user nova-compute[71689]:   <devices>
Apr 14 17:06:49 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:06:49 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:06:49 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk"/>
Apr 14 17:06:49 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:06:49 user nova-compute[71689]:     </disk>
Apr 14 17:06:49 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:06:49 user nova-compute[71689]:       <mac address="fa:16:3e:df:7c:ed"/>
Apr 14 17:06:49 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:06:49 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:06:49 user nova-compute[71689]:       <target dev="tap179579bb-9a"/>
Apr 14 17:06:49 user nova-compute[71689]:     </interface>
Apr 14 17:06:49 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:06:49 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/console.log" append="off"/>
Apr 14 17:06:49 user nova-compute[71689]:     </serial>
Apr 14 17:06:49 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:06:49 user nova-compute[71689]:     <video>
Apr 14 17:06:49 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:06:49 user nova-compute[71689]:     </video>
Apr 14 17:06:49 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:06:49 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:06:49 user nova-compute[71689]:     </rng>
Apr 14 17:06:49 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:06:49 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:06:49 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:06:49 user nova-compute[71689]:     </memballoon>
Apr 14 17:06:49 user nova-compute[71689]:   </devices>
Apr 14 17:06:49 user nova-compute[71689]: </domain>
Apr 14 17:06:49 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1952305466',display_name='tempest-VolumesAdminNegativeTest-server-1952305466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1952305466',id=13,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c8f41946e544d0c93cbceb3d03e50a5',ramdisk_id='',reservation_id='r-dmhf42gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2070911352',owner_user_name='tempest-VolumesAdminNegativeTest-2070911352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:06:48Z,user_data=None,user_id='01d0e8ec192748edbe2576ef1c1e1cb5',uuid=8c51fc1f-dcf6-4c42-8a4f-4b489c270895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converting VIF {"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG os_vif [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap179579bb-9a, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap179579bb-9a, col_values=(('external_ids', {'iface-id': '179579bb-9a96-4128-bdc5-35cbeca29ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:7c:ed', 'vm-uuid': '8c51fc1f-dcf6-4c42-8a4f-4b489c270895'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:49 user nova-compute[71689]: INFO os_vif [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a')
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:06:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] No VIF found with MAC fa:16:3e:df:7c:ed, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:06:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Updated VIF entry in instance network info cache for port 179579bb-9a96-4128-bdc5-35cbeca29ff5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:06:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Updating instance_info_cache with network_info: [{"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:06:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Releasing lock "refresh_cache-8c51fc1f-dcf6-4c42-8a4f-4b489c270895" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received event network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] No waiting events found dispatching network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:51 user nova-compute[71689]: WARNING nova.compute.manager [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received unexpected event network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance with vm_state building and task_state spawning.
Apr 14 17:06:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492013.304213, 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] VM Resumed (Lifecycle Event)
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Instance spawned successfully.
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492013.3085613, 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] VM Started (Lifecycle Event)
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received event network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] No waiting events found dispatching network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:06:53 user nova-compute[71689]: WARNING nova.compute.manager [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received unexpected event network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance with vm_state building and task_state spawning.
Apr 14 17:06:53 user nova-compute[71689]: INFO nova.compute.manager [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Took 6.49 seconds to build instance.
Apr 14 17:06:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.590s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:06:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:06:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:00 user nova-compute[71689]: INFO nova.compute.manager [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Terminating instance
Apr 14 17:07:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-unplugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-unplugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-unplugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:07:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Instance destroyed successfully.
Apr 14 17:07:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'resources' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042660194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1042660194',id=9,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ==',key_name='tempest-keypair-692507657',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='924256f7ef8c4a5a832a87d1c198c50a',ramdisk_id='',reservation_id='r-cp19oilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1726748799',owner_user_name='tempest-TaggedAttachmentsTest-1726748799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c31588acbcc345519934f4c3a395b0c5',uuid=113dda5c-a61e-423b-86ea-2fe30a113173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converting VIF {"id": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "address": "fa:16:3e:37:3a:79", "network": {"id": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-457473537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "924256f7ef8c4a5a832a87d1c198c50a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ea1bd9-f0", "ovs_interfaceid": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG os_vif [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34ea1bd9-f0, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:02 user nova-compute[71689]: INFO os_vif [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=34ea1bd9-f010-4073-bf8d-351b0e85ceeb,network=Network(d5e124d4-8ab6-4d66-b15c-92acd7a77bdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ea1bd9-f0')
Apr 14 17:07:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Deleting instance files /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173_del
Apr 14 17:07:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Deletion of /opt/stack/data/nova/instances/113dda5c-a61e-423b-86ea-2fe30a113173_del complete
Apr 14 17:07:02 user nova-compute[71689]: INFO nova.compute.manager [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 14 17:07:02 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:07:02 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:02 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Took 0.84 seconds to deallocate network for instance.
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Acquiring lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Lock "113dda5c-a61e-423b-86ea-2fe30a113173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] No waiting events found dispatching network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:03 user nova-compute[71689]: WARNING nova.compute.manager [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received unexpected event network-vif-plugged-34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance with vm_state deleted and task_state None.
Apr 14 17:07:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Received event network-vif-deleted-34ea1bd9-f010-4073-bf8d-351b0e85ceeb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:03 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Deleted allocations for instance 113dda5c-a61e-423b-86ea-2fe30a113173
Apr 14 17:07:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "113dda5c-a61e-423b-86ea-2fe30a113173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.793s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "fb079a50-7726-4957-b853-d10c7cba46fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:07:06 user nova-compute[71689]: INFO nova.compute.claims [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Claim successful on node user
Apr 14 17:07:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:07:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:07:06 user nova-compute[71689]: INFO nova.virt.block_device [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Booting with volume 5c124c18-317b-4292-9e62-828a770d71d1 at /dev/vda
Apr 14 17:07:06 user nova-compute[71689]: DEBUG os_brick.utils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8454a5cc-5726-4162-a427-2d3238d6893c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG nova.policy [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1560f-dffd-4801-9fd5-f7deaab5b8b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[409459fc-9db9-4cc1-a334-bd5f2be4d3ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff0325c-a37a-459e-b142-5d5f0482e7c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:07:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:07 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:07:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac74501-8c91-4146-9b4a-371ff6569064]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG os_brick.utils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating existing volume attachment record: 414bb875-790c-4de0-b193-49cf89055ed2 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:07:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:08 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully created port: ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:07:08 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully created port: af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:07:09 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully created port: d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:07:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully created port: 0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:07:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully created port: 84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-ae212ee6-7785-475c-a4cf-1014775b96a5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7465a41f-c916-4cca-8084-7c646409007d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:11 user nova-compute[71689]: INFO nova.compute.manager [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Terminating instance
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-vif-unplugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] No waiting events found dispatching network-vif-unplugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-vif-unplugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:07:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.network.neutron [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Instance destroyed successfully.
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lazy-loading 'resources' on Instance uuid 7465a41f-c916-4cca-8084-7c646409007d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-373292303',display_name='tempest-ServersNegativeTestJSON-server-373292303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-373292303',id=11,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='426156fb00db428683851cf731b680d1',ramdisk_id='',reservation_id='r-osz49w3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1832599821',owner_user_name='tempest-ServersNegativeTestJSON-1832599821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:28Z,user_data=None,user_id='0d1ea0218b044c1e94f61a07c1d14a75',uuid=7465a41f-c916-4cca-8084-7c646409007d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converting VIF {"id": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "address": "fa:16:3e:80:d0:2b", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c17c3d-5f", "ovs_interfaceid": "94c17c3d-5fae-4403-bc19-875a6a0ff264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG os_vif [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c17c3d-5f, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:12 user nova-compute[71689]: INFO os_vif [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=94c17c3d-5fae-4403-bc19-875a6a0ff264,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c17c3d-5f')
Apr 14 17:07:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Deleting instance files /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d_del
Apr 14 17:07:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Deletion of /opt/stack/data/nova/instances/7465a41f-c916-4cca-8084-7c646409007d_del complete
Apr 14 17:07:12 user nova-compute[71689]: INFO nova.compute.manager [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 17:07:12 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:07:12 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:13 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Took 0.81 seconds to deallocate network for instance.
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-vif-deleted-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:13 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Deleted allocations for instance 7465a41f-c916-4cca-8084-7c646409007d
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-ac7ba708-31ec-460a-bcad-14c6b7fb2bea. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7465a41f-c916-4cca-8084-7c646409007d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.997s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received event network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Acquiring lock "7465a41f-c916-4cca-8084-7c646409007d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Lock "7465a41f-c916-4cca-8084-7c646409007d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] No waiting events found dispatching network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:13 user nova-compute[71689]: WARNING nova.compute.manager [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Received unexpected event network-vif-plugged-94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance with vm_state deleted and task_state None.
Apr 14 17:07:14 user nova-compute[71689]: DEBUG nova.network.neutron [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:14 user nova-compute[71689]: INFO nova.virt.block_device [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Booting with volume 1ed99bca-7d21-4bc3-a44b-7ff5945370c8 at /dev/vdb
Apr 14 17:07:14 user nova-compute[71689]: DEBUG os_brick.utils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1934828c-b32b-45ba-bfca-3d769f960df3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d528ae1-8b63-486e-9b4c-983dc064bde3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f56b08-f456-46ad-89a8-8f544137b782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d7bc24-f80e-4128-8a9d-620de770f271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:14 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:07:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[151314d3-763f-47d1-8819-670c57067272]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG os_brick.utils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating existing volume attachment record: ff855b1a-633c-462f-80d0-075e7ac64cc2 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:14 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: 0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-af8c94dd-8947-4377-b332-64f1da7f7ea6. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:15 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-d98ca06a-3268-4d34-9fe9-524860935952. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Successfully updated port: 84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-0ecf5b01-5002-45ce-95cb-730296ee6817. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port 0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:16 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492021.9837086, 113dda5c-a61e-423b-86ea-2fe30a113173 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:16 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] VM Stopped (Lifecycle Event)
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d36dccbc-707d-4efc-81f8-f9a6c3a80769 None None] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.network.neutron [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-84d71284-fb7a-4263-8388-5526e6d4e033. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:18 user nova-compute[71689]: INFO nova.compute.manager [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Terminating instance
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-vif-unplugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] No waiting events found dispatching network-vif-unplugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-vif-unplugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [{"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance network_info: |[{"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.network.neutron [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port 84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:19 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Instance destroyed successfully.
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.objects.instance [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'resources' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1182786727',display_name='tempest-TestVolumeSwap-server-1182786727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1182786727',id=8,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc6ZfHKt1uU+YGTbQLPmXILQNP6tSFg76jl8Mc8eG/MpxCs2x8HxBR+c4ZFft6r9N7HjR6vD866q3goCTmG74sv9Hr3kvUkBHdg1JMK5TKDs2H70tdLAEuBaOJNax57+w==',key_name='tempest-keypair-1178292474',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e21607283fae4bd0a679948ea8fa4881',ramdisk_id='',reservation_id='r-zsopf5nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1289119351',owner_user_name='tempest-TestVolumeSwap-1289119351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79ebfd1410c4ffda69bc3bfaebbc25d',uuid=f53cfe1f-c915-4a74-8512-84a97147f1d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Converting VIF {"id": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "address": "fa:16:3e:3e:a5:f6", "network": {"id": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-305341129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e21607283fae4bd0a679948ea8fa4881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe61768-29", "ovs_interfaceid": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG os_vif [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfe61768-29, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:19 user nova-compute[71689]: INFO os_vif [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a5:f6,bridge_name='br-int',has_traffic_filtering=True,id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2,network=Network(895fe8ee-807e-44d1-a05e-3b9f2ff7af8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe61768-29')
Apr 14 17:07:19 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Deleting instance files /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1_del
Apr 14 17:07:19 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Deletion of /opt/stack/data/nova/instances/f53cfe1f-c915-4a74-8512-84a97147f1d1_del complete
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:19 user nova-compute[71689]: INFO nova.compute.manager [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 14 17:07:19 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:07:19 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG nova.network.neutron [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updated VIF entry in instance network info cache for port 84d71284-fb7a-4263-8388-5526e6d4e033. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG nova.network.neutron [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [{"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:20 user nova-compute[71689]: INFO nova.virt.block_device [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Booting with volume 3a0f18d8-07b9-41ce-a064-e0d321058ef6 at /dev/vdc
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG os_brick.utils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba31ca8-651d-4268-817d-87f519cbc163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ec9bab-b215-4506-a91b-ac153ff95fb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96ab70-708f-4d8c-914d-5e4279c63712]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec5436-4851-4677-9d18-e1d9a737ccb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:20 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:07:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f97e367-68c7-49a3-874b-5209a843f0ce]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG os_brick.utils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== get_connector_properties: return (538ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating existing volume attachment record: 73b93ec5-5b6a-49b3-94be-a48b2a4cd72d {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-vif-deleted-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:21 user nova-compute[71689]: INFO nova.compute.manager [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Neutron deleted interface dfe61768-29ed-4753-b77a-dcc14e1ce6c2; detaching it from the instance and deleting it from the info cache
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.network.neutron [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:21 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:21 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8022MB free_disk=26.557552337646484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:21 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Took 1.24 seconds to deallocate network for instance.
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Detach interface failed, port_id=dfe61768-29ed-4753-b77a-dcc14e1ce6c2, reason: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c0488788-7b88-4c48-9fcd-02640c09feb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance fb079a50-7726-4957-b853-d10c7cba46fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received event network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Acquiring lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] No waiting events found dispatching network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:21 user nova-compute[71689]: WARNING nova.compute.manager [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Received unexpected event network-vif-plugged-dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance with vm_state deleted and task_state None.
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.381s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:22 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Deleted allocations for instance f53cfe1f-c915-4a74-8512-84a97147f1d1
Apr 14 17:07:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "f53cfe1f-c915-4a74-8512-84a97147f1d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.177s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:07:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:07:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:07:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:07:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:26 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:07:26 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'info_cache' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492032.1983895, 7465a41f-c916-4cca-8084-7c646409007d => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:27 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7465a41f-c916-4cca-8084-7c646409007d] VM Stopped (Lifecycle Event)
Apr 14 17:07:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance destroyed successfully.
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'resources' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b058b2-e8c6-4157-b662-617494a0e327 None None] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed5f4a5-3c, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:27 user nova-compute[71689]: INFO os_vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c')
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:27 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcff7ad4-dfe3-41fb-aa37-c8ea7464b89b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:07:27 user nova-compute[71689]: No targets found.
Apr 14 17:07:27 user nova-compute[71689]: iSNS:
Apr 14 17:07:27 user nova-compute[71689]: No targets found.
Apr 14 17:07:27 user nova-compute[71689]: STATIC:
Apr 14 17:07:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:07:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:07:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:07:27 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:07:27 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:07:27 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:07:27 user nova-compute[71689]: FIRMWARE:
Apr 14 17:07:27 user nova-compute[71689]: No targets found.
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:07:27 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:07:27 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c5aac-bf1c-4223-885f-7d6e970ff3b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d2e30-1250-4256-90e5-add8e43c8c69]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:27 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:27 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b594d2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf'): ({'sdf'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Removing single pathed devices sdf {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09bb9f4-eb78-411b-b7e8-b8375c9a8665]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0a0c9-48b5-49f9-9ffe-61c45974ffd5]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flushing IO for device /dev/sdf {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ceacf5-bae5-4d4d-ac48-143158a260b3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7bab23-c408-4331-bfe5-469741a1a111]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] SCSI volumes sdf have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb848336-a429-40de-a44c-16e0583f3602]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec9b94-01a3-46cc-aa1e-4cf325f976a9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]
Apr 14 17:07:27 user nova-compute[71689]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e6e71-ba93-4f73-88fb-7ed4158d586f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== disconnect_volume: return (334ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start _get_guest_xml network_info=[{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd68b702a-a0dc-4030-9893-87b4ef44fb97', 'attached_at': '', 'detached_at': '', 'volume_id': '7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'serial': '7ef40a58-0f55-4cad-9da8-5f08f9070aaf'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'dba74166-c110-4ad7-807f-355d20fb3455', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'numa_topology' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:27 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:27 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'vcpu_model' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:27 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:27 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:27 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4baf04e-e94d-49cc-862b-59b1f9f266db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:07:27 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee885df-3aeb-4b5b-ab51-076a9a4e7fc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf] added
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9616f7-ced8-409a-bcf8-3b6baf76fb97]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30ca48-cbc2-4832-b8ed-ebe9bce36fb0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjabkIdn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjabkIdn" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e5725-8e8a-414f-880d-fdf2b3cdb361]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjabkIdn'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc320c4-ed0f-49e6-9107-683a056ffdd3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7d351-b6cd-4090-aeb7-7db2c764e741]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3102d504-d8fe-4d15-942b-6525df3a5d43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]
Apr 14 17:07:27 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.
Apr 14 17:07:27 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c27d359-68ea-4373-81e0-c7e43f727604]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce733200-a549-45c6-b960-884ada1f9ae1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:28 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:28 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:28 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1eb19-7bda-478f-a544-7801107e21b8]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'flavor' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:28 user nova-compute[71689]: INFO nova.compute.manager [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Attaching volume e5dc56d4-d704-4e10-8ed6-33153ab29a68 to /dev/vdb
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.utils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00939c7-1dd4-4fb5-84ca-98b477e30289]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f813c7-2c1f-48a3-ae31-a824153a9b99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:07:28 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Creating image(s)
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Ensure instance console log exists: /opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Start _get_guest_xml network_info=[{"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXfcbwxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb079a50-7726-4957-b853-d10c7cba46fb', 'attached_at': '', 'detached_at': '', 'volume_id': '5c124c18-317b-4292-9e62-828a770d71d1', 'serial': '5c124c18-317b-4292-9e62-828a770d71d1'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '414bb875-790c-4de0-b193-49cf89055ed2', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqNfMJiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb079a50-7726-4957-b853-d10c7cba46fb', 'attached_at': '', 'detached_at': '', 'volume_id': '1ed99bca-7d21-4bc3-a44b-7ff5945370c8', 'serial': '1ed99bca-7d21-4bc3-a44b-7ff5945370c8'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ff855b1a-633c-462f-80d0-075e7ac64cc2', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoAnHmSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb079a50-7726-4957-b853-d10c7cba46fb', 'attached_at': '', 'detached_at': '', 'volume_id': '3a0f18d8-07b9-41ce-a064-e0d321058ef6', 'serial': '3a0f18d8-07b9-41ce-a064-e0d321058ef6'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '73b93ec5-5b6a-49b3-94be-a48b2a4cd72d', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:28 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXfcbwxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:28 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[753723cf-f46b-4168-b098-1a3a04099e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2562fb4-7bc1-4693-bb6b-9e4a66c29988]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:07:28 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:07:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02d8dd7-e49a-470c-a31c-c36ff9f229f7]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG os_brick.utils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:28 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating existing volume attachment record: 6fba17f8-456b-4b57-ad99-8038e8b8924e {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23733326337363633', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733326337363633', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.279s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:29 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:29 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4657f61f-7b6e-4495-b6f4-f5c9fa200476]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:07:29 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'pci_devices' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[20847c96-4e96-440a-90db-d397c823a98f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1] added
Apr 14 17:07:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:07:29 user nova-compute[71689]:   <uuid>d68b702a-a0dc-4030-9893-87b4ef44fb97</uuid>
Apr 14 17:07:29 user nova-compute[71689]:   <name>instance-00000003</name>
Apr 14 17:07:29 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:07:29 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:07:29 user nova-compute[71689]:   <metadata>
Apr 14 17:07:29 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:07:29 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:07:29 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeTestJSON-server-1946928573</nova:name>
Apr 14 17:07:29 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:07:27</nova:creationTime>
Apr 14 17:07:29 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:07:29 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:07:29 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:07:29 user nova-compute[71689]:       <nova:owner>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:user uuid="d7c4734925f645248b0f9060aa78a502">tempest-AttachVolumeTestJSON-917907278-project-member</nova:user>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:project uuid="0c8f6b39515e456c9f5a1affa9f79000">tempest-AttachVolumeTestJSON-917907278</nova:project>
Apr 14 17:07:29 user nova-compute[71689]:       </nova:owner>
Apr 14 17:07:29 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:07:29 user nova-compute[71689]:       <nova:ports>
Apr 14 17:07:29 user nova-compute[71689]:         <nova:port uuid="6ed5f4a5-3c4e-48f6-8667-efda89e23575">
Apr 14 17:07:29 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:07:29 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:29 user nova-compute[71689]:       </nova:ports>
Apr 14 17:07:29 user nova-compute[71689]:     </nova:instance>
Apr 14 17:07:29 user nova-compute[71689]:   </metadata>
Apr 14 17:07:29 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:07:29 user nova-compute[71689]:     <system>
Apr 14 17:07:29 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:07:29 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:07:29 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:07:29 user nova-compute[71689]:       <entry name="serial">d68b702a-a0dc-4030-9893-87b4ef44fb97</entry>
Apr 14 17:07:29 user nova-compute[71689]:       <entry name="uuid">d68b702a-a0dc-4030-9893-87b4ef44fb97</entry>
Apr 14 17:07:29 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:07:29 user nova-compute[71689]:     </system>
Apr 14 17:07:29 user nova-compute[71689]:   </sysinfo>
Apr 14 17:07:29 user nova-compute[71689]:   <os>
Apr 14 17:07:29 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:07:29 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:07:29 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:07:29 user nova-compute[71689]:   </os>
Apr 14 17:07:29 user nova-compute[71689]:   <features>
Apr 14 17:07:29 user nova-compute[71689]:     <acpi/>
Apr 14 17:07:29 user nova-compute[71689]:     <apic/>
Apr 14 17:07:29 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:07:29 user nova-compute[71689]:   </features>
Apr 14 17:07:29 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:07:29 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:07:29 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:07:29 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:07:29 user nova-compute[71689]:   </clock>
Apr 14 17:07:29 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:07:29 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:07:29 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:07:29 user nova-compute[71689]:   </cpu>
Apr 14 17:07:29 user nova-compute[71689]:   <devices>
Apr 14 17:07:29 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:07:29 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:07:29 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk"/>
Apr 14 17:07:29 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:07:29 user nova-compute[71689]:     </disk>
Apr 14 17:07:29 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:07:29 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:07:29 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:07:29 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:07:29 user nova-compute[71689]:       <serial>7ef40a58-0f55-4cad-9da8-5f08f9070aaf</serial>
Apr 14 17:07:29 user nova-compute[71689]:     </disk>
Apr 14 17:07:29 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:29 user nova-compute[71689]:       <mac address="fa:16:3e:bf:7d:0c"/>
Apr 14 17:07:29 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:29 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:29 user nova-compute[71689]:       <target dev="tap6ed5f4a5-3c"/>
Apr 14 17:07:29 user nova-compute[71689]:     </interface>
Apr 14 17:07:29 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:07:29 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/console.log" append="off"/>
Apr 14 17:07:29 user nova-compute[71689]:     </serial>
Apr 14 17:07:29 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:07:29 user nova-compute[71689]:     <video>
Apr 14 17:07:29 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:29 user nova-compute[71689]:     </video>
Apr 14 17:07:29 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:07:29 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:07:29 user nova-compute[71689]:     </rng>
Apr 14 17:07:29 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:07:29 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:07:29 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:07:29 user nova-compute[71689]:     </memballoon>
Apr 14 17:07:29 user nova-compute[71689]:   </devices>
Apr 14 17:07:29 user nova-compute[71689]: </domain>
Apr 14 17:07:29 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae774cd-48c0-40f4-8446-e99ff1de6e61]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b30d37-8116-4e8e-8303-b73cb70c8fd0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXfcbwxC {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXfcbwxC" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a19669-0e3e-4bd4-84fb-79b95d7836a4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PXfcbwxC'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bde2a1e-b64e-4eb4-86be-af49672885be]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[897c5ce9-5bfa-4eb3-af1a-a25cd97409f5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:29 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:29 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e39cd7-ae7e-4eca-8513-f13641ac09b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260]
Apr 14 17:07:29 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260] successful.
Apr 14 17:07:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af61479-da54-49da-aa1d-a59a2ee53164]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e50ba99-42f9-4b25-80cc-d41a85a30540]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:29 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:29 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:29 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:29 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:29 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d811073a-08b4-48a7-9347-00f262e8cf5a]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'trusted_certs' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Cannot resize image /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'migration_context' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG os_vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed5f4a5-3c, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ed5f4a5-3c, col_values=(('external_ids', {'iface-id': '6ed5f4a5-3c4e-48f6-8667-efda89e23575', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:7d:0c', 'vm-uuid': 'd68b702a-a0dc-4030-9893-87b4ef44fb97'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:29 user nova-compute[71689]: INFO os_vif [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c')
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXfcbwxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== connect_volume: return (1612ms) {'type': 'block', 'scsi_wwn': '23966626362383531', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966626362383531', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqNfMJiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:30 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:30 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:30 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2aac8-84c1-4f8f-a0eb-4815893d749c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:07:30 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903b593-49e2-4d99-9ab8-a2a059a73617]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8] added
Apr 14 17:07:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e9d80-c9f0-445a-be9a-3a1bc6cd5dcb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97db841-8a02-4cd9-87fd-e6364dc52e7d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqNfMJiz {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqNfMJiz" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5fef03-b3d6-4933-bac1-7e92510f3978]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqNfMJiz'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1caf6d-6809-4d55-aa6d-e33cde30c5a7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d151a244-7b21-47a3-ab0d-1a5959fdf35a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1076bea-c417-4f56-8359-a7518bed2b62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260]
Apr 14 17:07:30 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260] successful.
Apr 14 17:07:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0623706d-115c-4141-80c5-25758007865b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b7bc32-9a83-4b63-a607-2c748ee5fcd2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:30 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce27607-446e-49a8-9521-6863df37e0bb]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-changed-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Refreshing instance network info cache due to event network-changed-4674caf0-77c1-4de1-a665-db3fde68e9bb. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Acquiring lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Acquired lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG nova.network.neutron [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Refreshing network info cache for port 4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:31 user nova-compute[71689]: INFO nova.compute.manager [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Terminating instance
Apr 14 17:07:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqNfMJiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23335663664343734', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335663664343734', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoAnHmSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:31 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:31 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:31 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d891d-a67f-41f2-894a-9807e2e1498f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:07:31 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77437211-9ea9-4da5-a6c4-17304c9fc9b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6] added
Apr 14 17:07:31 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee818c-5cdb-4fa2-bc89-090a47bdd84f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[413627a9-817d-4a11-ab71-5bb72fa6ddb0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoAnHmSu {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoAnHmSu" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a62b3e-247c-486f-9dac-9461d83b0686]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BoAnHmSu'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.070s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5851ced-d6c0-4cfe-bacc-5112c7710478]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf7d94-7610-4628-b857-8d3a3d1188b0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2174829-5d49-4058-8449-4da64dd2c395]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260]
Apr 14 17:07:32 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260] successful.
Apr 14 17:07:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd11940-cc89-4fa2-aa17-2a8f3d008d24]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-vif-unplugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] No waiting events found dispatching network-vif-unplugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-vif-unplugged-4674caf0-77c1-4de1-a665-db3fde68e9bb for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bebb41-baf4-46f3-b14b-05c6f15c056c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:32 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Updated VIF entry in instance network info cache for port 4674caf0-77c1-4de1-a665-db3fde68e9bb. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Updating instance_info_cache with network_info: [{"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76254e55-b4a0-4d2d-b161-68133e476891]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoAnHmSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Releasing lock "refresh_cache-3469a45b-e63a-4871-a6c5-deece7f4ecfd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Instance destroyed successfully.
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.objects.instance [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'resources' on Instance uuid 3469a45b-e63a-4871-a6c5-deece7f4ecfd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1521815605',display_name='tempest-AttachVolumeNegativeTest-server-1521815605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1521815605',id=12,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+Zm1ctsV4wvEsTcBuyV4czpQkG0nl/+xyA5iP1tq9gjgmi51R5vjpJ5uOCEzngZBoovymkqc8E81yq7xGrxfiaEQcdxPLfkSbxVyw8dAp1esxCIm+M5nPc8fDIlB6wQ==',key_name='tempest-keypair-122500492',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:05:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-yituv6ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=3469a45b-e63a-4871-a6c5-deece7f4ecfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "address": "fa:16:3e:24:53:5d", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4674caf0-77", "ovs_interfaceid": "4674caf0-77c1-4de1-a665-db3fde68e9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG os_vif [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4674caf0-77, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:32 user nova-compute[71689]: INFO os_vif [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:53:5d,bridge_name='br-int',has_traffic_filtering=True,id=4674caf0-77c1-4de1-a665-db3fde68e9bb,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4674caf0-77')
Apr 14 17:07:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Deleting instance files /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd_del
Apr 14 17:07:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Deletion of /opt/stack/data/nova/instances/3469a45b-e63a-4871-a6c5-deece7f4ecfd_del complete
Apr 14 17:07:32 user nova-compute[71689]: INFO nova.compute.manager [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 17:07:32 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:07:32 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== connect_volume: return (1514ms) {'type': 'block', 'scsi_wwn': '26263333234616339', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263333234616339', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:33 user nova-compute[71689]: WARNING nova.compute.manager [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state powering-on.
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:33 user nova-compute[71689]: WARNING nova.compute.manager [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state powering-on.
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lazy-loading 'pci_devices' on Instance uuid fb079a50-7726-4957-b853-d10c7cba46fb {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:07:33 user nova-compute[71689]:   <uuid>fb079a50-7726-4957-b853-d10c7cba46fb</uuid>
Apr 14 17:07:33 user nova-compute[71689]:   <name>instance-0000000e</name>
Apr 14 17:07:33 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:07:33 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:07:33 user nova-compute[71689]:   <metadata>
Apr 14 17:07:33 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:07:33 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:07:33 user nova-compute[71689]:       <nova:name>tempest-device-tagging-server-703690354</nova:name>
Apr 14 17:07:33 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:07:28</nova:creationTime>
Apr 14 17:07:33 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:07:33 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:07:33 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:07:33 user nova-compute[71689]:       <nova:owner>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:user uuid="eef6f58f76314333b233365266ef5c57">tempest-TaggedBootDevicesTest_v242-195680184-project-member</nova:user>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:project uuid="447e75d0cc144b9ab741d8591af3959e">tempest-TaggedBootDevicesTest_v242-195680184</nova:project>
Apr 14 17:07:33 user nova-compute[71689]:       </nova:owner>
Apr 14 17:07:33 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:07:33 user nova-compute[71689]:       <nova:ports>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="ae212ee6-7785-475c-a4cf-1014775b96a5">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="ac7ba708-31ec-460a-bcad-14c6b7fb2bea">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="af8c94dd-8947-4377-b332-64f1da7f7ea6">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="d98ca06a-3268-4d34-9fe9-524860935952">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="0ecf5b01-5002-45ce-95cb-730296ee6817">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:         <nova:port uuid="84d71284-fb7a-4263-8388-5526e6d4e033">
Apr 14 17:07:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 17:07:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:33 user nova-compute[71689]:       </nova:ports>
Apr 14 17:07:33 user nova-compute[71689]:     </nova:instance>
Apr 14 17:07:33 user nova-compute[71689]:   </metadata>
Apr 14 17:07:33 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:07:33 user nova-compute[71689]:     <system>
Apr 14 17:07:33 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:07:33 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:07:33 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:07:33 user nova-compute[71689]:       <entry name="serial">fb079a50-7726-4957-b853-d10c7cba46fb</entry>
Apr 14 17:07:33 user nova-compute[71689]:       <entry name="uuid">fb079a50-7726-4957-b853-d10c7cba46fb</entry>
Apr 14 17:07:33 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:07:33 user nova-compute[71689]:     </system>
Apr 14 17:07:33 user nova-compute[71689]:   </sysinfo>
Apr 14 17:07:33 user nova-compute[71689]:   <os>
Apr 14 17:07:33 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:07:33 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:07:33 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:07:33 user nova-compute[71689]:   </os>
Apr 14 17:07:33 user nova-compute[71689]:   <features>
Apr 14 17:07:33 user nova-compute[71689]:     <acpi/>
Apr 14 17:07:33 user nova-compute[71689]:     <apic/>
Apr 14 17:07:33 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:07:33 user nova-compute[71689]:   </features>
Apr 14 17:07:33 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:07:33 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:07:33 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:07:33 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:07:33 user nova-compute[71689]:   </clock>
Apr 14 17:07:33 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:07:33 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:07:33 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:07:33 user nova-compute[71689]:   </cpu>
Apr 14 17:07:33 user nova-compute[71689]:   <devices>
Apr 14 17:07:33 user nova-compute[71689]:     <disk type="file" device="cdrom">
Apr 14 17:07:33 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 17:07:33 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb/disk.config"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="hda" bus="ide"/>
Apr 14 17:07:33 user nova-compute[71689]:     </disk>
Apr 14 17:07:33 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:07:33 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:07:33 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <serial>5c124c18-317b-4292-9e62-828a770d71d1</serial>
Apr 14 17:07:33 user nova-compute[71689]:     </disk>
Apr 14 17:07:33 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:07:33 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:07:33 user nova-compute[71689]:       <source dev="/dev/sdd"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <serial>1ed99bca-7d21-4bc3-a44b-7ff5945370c8</serial>
Apr 14 17:07:33 user nova-compute[71689]:     </disk>
Apr 14 17:07:33 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:07:33 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:07:33 user nova-compute[71689]:       <source dev="/dev/sde"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="vdc" bus="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <serial>3a0f18d8-07b9-41ce-a064-e0d321058ef6</serial>
Apr 14 17:07:33 user nova-compute[71689]:     </disk>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:84:8e:20"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tapae212ee6-77"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:d0:aa:b7"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tapac7ba708-31"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:2d:00:a9"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tapc88a2f62-0f"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:42:80:e8"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tapaf8c94dd-89"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:17:37:8f"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tapd98ca06a-32"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:90:06:c6"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tap0ecf5b01-50"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:33 user nova-compute[71689]:       <mac address="fa:16:3e:db:62:6a"/>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:33 user nova-compute[71689]:       <target dev="tap84d71284-fb"/>
Apr 14 17:07:33 user nova-compute[71689]:     </interface>
Apr 14 17:07:33 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:07:33 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb/console.log" append="off"/>
Apr 14 17:07:33 user nova-compute[71689]:     </serial>
Apr 14 17:07:33 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:07:33 user nova-compute[71689]:     <video>
Apr 14 17:07:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:33 user nova-compute[71689]:     </video>
Apr 14 17:07:33 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:07:33 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:07:33 user nova-compute[71689]:     </rng>
Apr 14 17:07:33 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:07:33 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:07:33 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:07:33 user nova-compute[71689]:     </memballoon>
Apr 14 17:07:33 user nova-compute[71689]:   </devices>
Apr 14 17:07:33 user nova-compute[71689]: </domain>
Apr 14 17:07:33 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae212ee6-77, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae212ee6-77, col_values=(('external_ids', {'iface-id': 'ae212ee6-7785-475c-a4cf-1014775b96a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8e:20', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77')
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac7ba708-31, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac7ba708-31, col_values=(('external_ids', {'iface-id': 'ac7ba708-31ec-460a-bcad-14c6b7fb2bea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:aa:b7', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31')
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc88a2f62-0f, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc88a2f62-0f, col_values=(('external_ids', {'iface-id': 'c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:00:a9', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f')
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf8c94dd-89, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf8c94dd-89, col_values=(('external_ids', {'iface-id': 'af8c94dd-8947-4377-b332-64f1da7f7ea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:80:e8', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89')
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd98ca06a-32, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd98ca06a-32, col_values=(('external_ids', {'iface-id': 'd98ca06a-3268-4d34-9fe9-524860935952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:37:8f', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Took 0.98 seconds to deallocate network for instance.
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32')
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ecf5b01-50, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ecf5b01-50, col_values=(('external_ids', {'iface-id': '0ecf5b01-5002-45ce-95cb-730296ee6817', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:06:c6', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492053.790638, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Resumed (Lifecycle Event)
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:07:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance rebooted successfully.
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50')
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d71284-fb, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d71284-fb, col_values=(('external_ids', {'iface-id': '84d71284-fb7a-4263-8388-5526e6d4e033', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:62:6a', 'vm-uuid': 'fb079a50-7726-4957-b853-d10c7cba46fb'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492053.7909827, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Started (Lifecycle Event)
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 17:07:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:33 user nova-compute[71689]: INFO os_vif [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb')
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] No BDM found with device name hda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] No VIF found with MAC fa:16:3e:84:8e:20, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] No VIF found with MAC fa:16:3e:17:37:8f, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:07:34 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Using config drive
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:34 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Deleted allocations for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd
Apr 14 17:07:34 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Creating config drive at /opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb/disk.config
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgqq1gtmw {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgqq1gtmw" returned: 0 in 0.075s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.608s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Acquiring lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Lock "3469a45b-e63a-4871-a6c5-deece7f4ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] No waiting events found dispatching network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:34 user nova-compute[71689]: WARNING nova.compute.manager [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received unexpected event network-vif-plugged-4674caf0-77c1-4de1-a665-db3fde68e9bb for instance with vm_state deleted and task_state None.
Apr 14 17:07:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492039.7879314, f53cfe1f-c915-4a74-8512-84a97147f1d1 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:34 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] VM Stopped (Lifecycle Event)
Apr 14 17:07:34 user nova-compute[71689]: DEBUG nova.compute.manager [None req-6f9517f8-cd6c-4868-bad7-10a59fccb768 None None] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Received event network-vif-deleted-4674caf0-77c1-4de1-a665-db3fde68e9bb {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:37 user nova-compute[71689]: WARNING nova.compute.manager [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance with vm_state building and task_state spawning.
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:37 user nova-compute[71689]: WARNING nova.compute.manager [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 for instance with vm_state building and task_state spawning.
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:37 user nova-compute[71689]: WARNING nova.compute.manager [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 for instance with vm_state building and task_state spawning.
Apr 14 17:07:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbBPYtXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:37 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:37 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:37 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e5519-d31f-41eb-b400-baa9f12f90bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:07:37 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b4124b-5ff5-44f8-913f-82429209cc4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68] added
Apr 14 17:07:37 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f0bb6-d816-487f-9a01-635084081d47]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf192157-2ac3-4f05-bf1a-6fd7335cc488]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbBPYtXw {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbBPYtXw" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cddee3-ed5a-4a13-ae4c-5c8242a61674]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbBPYtXw'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1ca4f-8e51-42fe-80d9-27c0e7556238]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a693c-76ab-4ad7-8884-a00171689063]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:37 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:37 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:37 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[611cbbb9-ed3d-49f5-accf-ae27cbfc1f77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260]
Apr 14 17:07:37 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260] successful.
Apr 14 17:07:37 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8953d521-ef0e-48fd-aebb-3eaf84e224ca]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4942db-24e6-43b4-9752-28faa3c7d385]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:38 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:07:38 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:38 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d7021e-960f-4c66-be8a-01b0fdee4457]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbBPYtXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.482s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26432323239663865', 'path': '/dev/sdf'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432323239663865', 'path': '/dev/sdf'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'flavor' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:07:39 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:07:39 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:07:39 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:07:39 user nova-compute[71689]:   <serial>e5dc56d4-d704-4e10-8ed6-33153ab29a68</serial>
Apr 14 17:07:39 user nova-compute[71689]: </disk>
Apr 14 17:07:39 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No VIF found with MAC fa:16:3e:c3:f6:95, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:39 user nova-compute[71689]: WARNING nova.compute.manager [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 for instance with vm_state building and task_state spawning.
Apr 14 17:07:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.297s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Rescuing
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492061.1768389, fb079a50-7726-4957-b853-d10c7cba46fb => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] VM Resumed (Lifecycle Event)
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance spawned successfully.
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492061.18251, fb079a50-7726-4957-b853-d10c7cba46fb => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] VM Started (Lifecycle Event)
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Took 12.61 seconds to spawn the instance on the hypervisor.
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:07:41 user nova-compute[71689]: INFO nova.compute.manager [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Took 35.26 seconds to build instance.
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "fb079a50-7726-4957-b853-d10c7cba46fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.361s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:41 user nova-compute[71689]: WARNING nova.compute.manager [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 for instance with vm_state active and task_state None.
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:41 user nova-compute[71689]: WARNING nova.compute.manager [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 for instance with vm_state active and task_state None.
Apr 14 17:07:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:42 user nova-compute[71689]: WARNING nova.compute.manager [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state active and task_state rescuing.
Apr 14 17:07:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance destroyed successfully.
Apr 14 17:07:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Attempting a stable device rescue
Apr 14 17:07:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71689) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:07:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Creating image(s)
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "17bdf6cd9e2d26f675fe29289601017230dbec3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "17bdf6cd9e2d26f675fe29289601017230dbec3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.part --force-share --output=json" returned: 0 in 0.169s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:43 user nova-compute[71689]: DEBUG nova.virt.images [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 76d1cc2c-f73e-47b3-a798-4adb640ecdc8 was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:07:43 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:07:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.part /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.part /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.converted" returned: 0 in 0.244s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:44 user nova-compute[71689]: WARNING nova.compute.manager [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state active and task_state rescuing.
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "17bdf6cd9e2d26f675fe29289601017230dbec3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.615s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "17bdf6cd9e2d26f675fe29289601017230dbec3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "17bdf6cd9e2d26f675fe29289601017230dbec3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a,backing_fmt=raw /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a,backing_fmt=raw /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue" returned: 0 in 0.049s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "17bdf6cd9e2d26f675fe29289601017230dbec3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'migration_context' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Start _get_guest_xml network_info=[{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "vif_mac": "fa:16:3e:c3:f6:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76d1cc2c-f73e-47b3-a798-4adb640ecdc8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbBPYtXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd5920661-9030-4cf7-88a0-1ad789eec1bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'serial': 'e5dc56d4-d704-4e10-8ed6-33153ab29a68'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '6fba17f8-456b-4b57-ad99-8038e8b8924e', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'resources' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'numa_topology' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:44 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:44 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbBPYtXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:07:44 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:44 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:07:44 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6606417-adee-4e40-8065-ac0a2ff34b06]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UbBPYtXw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 17:07:44 user nova-compute[71689]: node.name = iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:07:44 user nova-compute[71689]: node.tpgt = -1
Apr 14 17:07:44 user nova-compute[71689]: node.startup = automatic
Apr 14 17:07:44 user nova-compute[71689]: node.leading_login = No
Apr 14 17:07:44 user nova-compute[71689]: iface.iscsi_ifacename = default
Apr 14 17:07:44 user nova-compute[71689]: iface.net_ifacename = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.ipaddress = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.prefix_len = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.hwaddress = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.transport_name = tcp
Apr 14 17:07:44 user nova-compute[71689]: iface.initiatorname = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.vlan_id = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.vlan_priority = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.vlan_state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.iface_num = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.mtu = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.port = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.bootproto = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.subnet_mask = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.gateway = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_alt_client_id = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_dns = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_learn_iqn = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_vendor_id_state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_vendor_id = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.dhcp_slp_da = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.fragmentation = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.gratuitous_arp = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.incoming_forwarding = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.tos_state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.tos = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.ttl = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.delayed_ack = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.tcp_nagle = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.tcp_wsf_state = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.tcp_wsf = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.tcp_timer_scale = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.tcp_timestamp = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.redirect = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.def_task_mgmt_timeout = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.header_digest = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.data_digest = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.immediate_data = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.initial_r2t = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.data_seq_inorder = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.data_pdu_inorder = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.erl = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.max_receive_data_len = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.first_burst_len = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.max_outstanding_r2t = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.max_burst_len = 0
Apr 14 17:07:44 user nova-compute[71689]: iface.chap_auth = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.bidi_chap = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.strict_login_compliance = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.discovery_auth = <empty>
Apr 14 17:07:44 user nova-compute[71689]: iface.discovery_logout = <empty>
Apr 14 17:07:44 user nova-compute[71689]: node.discovery_address = <empty>
Apr 14 17:07:44 user nova-compute[71689]: node.discovery_port = 0
Apr 14 17:07:44 user nova-compute[71689]: node.discovery_type = static
Apr 14 17:07:44 user nova-compute[71689]: node.session.initial_cmdsn = 0
Apr 14 17:07:44 user nova-compute[71689]: node.session.initial_login_retry_max = 8
Apr 14 17:07:44 user nova-compute[71689]: node.session.xmit_thread_priority = -20
Apr 14 17:07:44 user nova-compute[71689]: node.session.cmds_max = 128
Apr 14 17:07:44 user nova-compute[71689]: node.session.queue_depth = 32
Apr 14 17:07:44 user nova-compute[71689]: node.session.nr_sessions = 1
Apr 14 17:07:44 user nova-compute[71689]: node.session.auth.authmethod = CHAP
Apr 14 17:07:44 user nova-compute[71689]: node.session.auth.username = UbBPYtXw
Apr 14 17:07:44 user nova-compute[71689]: node.session.auth.password = ***
Apr 14 17:07:44 user nova-compute[71689]: node.session.auth.username_in = <empty>
Apr 14 17:07:44 user nova-compute[71689]: node.session.auth.password_in = <empty>
Apr 14 17:07:44 user nova-compute[71689]: node.session.auth.chap_algs = MD5
Apr 14 17:07:44 user nova-compute[71689]: node.session.timeo.replacement_timeout = 120
Apr 14 17:07:44 user nova-compute[71689]: node.session.err_timeo.abort_timeout = 15
Apr 14 17:07:44 user nova-compute[71689]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 17:07:44 user nova-compute[71689]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 17:07:44 user nova-compute[71689]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.FastAbort = Yes
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.InitialR2T = No
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.ImmediateData = Yes
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.MaxConnections = 1
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 17:07:44 user nova-compute[71689]: node.session.iscsi.ERL = 0
Apr 14 17:07:44 user nova-compute[71689]: node.session.scan = manual
Apr 14 17:07:44 user nova-compute[71689]: node.session.reopen_max = 0
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].address = 172.16.0.220
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].port = 3260
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].startup = manual
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].tcp.window_size = 524288
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].tcp.type_of_service = 0
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].timeo.logout_timeout = 15
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].timeo.login_timeout = 15
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].timeo.auth_timeout = 45
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].iscsi.DataDigest = None
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].iscsi.IFMarker = No
Apr 14 17:07:44 user nova-compute[71689]: node.conn[0].iscsi.OFMarker = No
Apr 14 17:07:44 user nova-compute[71689]: # END RECORD
Apr 14 17:07:44 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce608fd2-1113-478d-a1b7-d64ac3cabc5a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc83edbc-3bc4-4f87-8eeb-404c81bec0bf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbBPYtXw {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbBPYtXw" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd6f8a-bfb9-42fc-b897-71867dd750ef]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbBPYtXw'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75e780-2119-485c-9f9d-7daa9671e07c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[16983a16-3d80-42ce-878c-0fe5cd00bbc5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:44 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:07:44 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:07:44 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.187s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] HCTL ('37', '0', '0', 0) found on session 18 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[777cd6dc-0325-4de7-bbec-e9c722f55003]: (4, ('0 0 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Searching for a device in session 18 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbBPYtXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.219s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '26432323239663865', 'path': '/dev/sdf'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:07:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432323239663865', 'path': '/dev/sdf'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1113450813',display_name='tempest-ServerStableDeviceRescueTest-server-1113450813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1113450813',id=5,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzVLXKTMjj+oWgl5UjeCg470ILAsgtQRYzCsqgruNLBE9s509BMvlpfzsOb9vynIrkGPbYSSRskFS/m1TTup2eransCsvDdeWR+bzlyn30Rn6MOx9JQq0u/nbPnQu7vxQ==',key_name='tempest-keypair-1270943457',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fa2764eee6c4071b5607f78762ca653',ramdisk_id='',reservation_id='r-26b4b70p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-363765322',owner_user_name='tempest-ServerStableDeviceRescueTest-363765322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d67df67ba8e4905bf7c6545c5748a41',uuid=d5920661-9030-4cf7-88a0-1ad789eec1bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "vif_mac": "fa:16:3e:c3:f6:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converting VIF {"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "vif_mac": "fa:16:3e:c3:f6:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'pci_devices' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:07:45 user nova-compute[71689]:   <uuid>d5920661-9030-4cf7-88a0-1ad789eec1bd</uuid>
Apr 14 17:07:45 user nova-compute[71689]:   <name>instance-00000005</name>
Apr 14 17:07:45 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:07:45 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:07:45 user nova-compute[71689]:   <metadata>
Apr 14 17:07:45 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:07:45 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:07:45 user nova-compute[71689]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1113450813</nova:name>
Apr 14 17:07:45 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:07:44</nova:creationTime>
Apr 14 17:07:45 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:07:45 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:07:45 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:07:45 user nova-compute[71689]:       <nova:owner>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:user uuid="1d67df67ba8e4905bf7c6545c5748a41">tempest-ServerStableDeviceRescueTest-363765322-project-member</nova:user>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:project uuid="7fa2764eee6c4071b5607f78762ca653">tempest-ServerStableDeviceRescueTest-363765322</nova:project>
Apr 14 17:07:45 user nova-compute[71689]:       </nova:owner>
Apr 14 17:07:45 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:07:45 user nova-compute[71689]:       <nova:ports>
Apr 14 17:07:45 user nova-compute[71689]:         <nova:port uuid="526282d7-c5ce-4ae0-9745-4e43477222f0">
Apr 14 17:07:45 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:07:45 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:45 user nova-compute[71689]:       </nova:ports>
Apr 14 17:07:45 user nova-compute[71689]:     </nova:instance>
Apr 14 17:07:45 user nova-compute[71689]:   </metadata>
Apr 14 17:07:45 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:07:45 user nova-compute[71689]:     <system>
Apr 14 17:07:45 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:07:45 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:07:45 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:07:45 user nova-compute[71689]:       <entry name="serial">d5920661-9030-4cf7-88a0-1ad789eec1bd</entry>
Apr 14 17:07:45 user nova-compute[71689]:       <entry name="uuid">d5920661-9030-4cf7-88a0-1ad789eec1bd</entry>
Apr 14 17:07:45 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:07:45 user nova-compute[71689]:     </system>
Apr 14 17:07:45 user nova-compute[71689]:   </sysinfo>
Apr 14 17:07:45 user nova-compute[71689]:   <os>
Apr 14 17:07:45 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:07:45 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:07:45 user nova-compute[71689]:   </os>
Apr 14 17:07:45 user nova-compute[71689]:   <features>
Apr 14 17:07:45 user nova-compute[71689]:     <acpi/>
Apr 14 17:07:45 user nova-compute[71689]:     <apic/>
Apr 14 17:07:45 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:07:45 user nova-compute[71689]:   </features>
Apr 14 17:07:45 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:07:45 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:07:45 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:07:45 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:07:45 user nova-compute[71689]:   </clock>
Apr 14 17:07:45 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:07:45 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:07:45 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:07:45 user nova-compute[71689]:   </cpu>
Apr 14 17:07:45 user nova-compute[71689]:   <devices>
Apr 14 17:07:45 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:07:45 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:07:45 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk"/>
Apr 14 17:07:45 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:07:45 user nova-compute[71689]:     </disk>
Apr 14 17:07:45 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:07:45 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:07:45 user nova-compute[71689]:       <source dev="/dev/sdf"/>
Apr 14 17:07:45 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:07:45 user nova-compute[71689]:       <serial>e5dc56d4-d704-4e10-8ed6-33153ab29a68</serial>
Apr 14 17:07:45 user nova-compute[71689]:     </disk>
Apr 14 17:07:45 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:07:45 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:07:45 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue"/>
Apr 14 17:07:45 user nova-compute[71689]:       <target dev="vdc" bus="virtio"/>
Apr 14 17:07:45 user nova-compute[71689]:       <boot order="1"/>
Apr 14 17:07:45 user nova-compute[71689]:     </disk>
Apr 14 17:07:45 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:45 user nova-compute[71689]:       <mac address="fa:16:3e:c3:f6:95"/>
Apr 14 17:07:45 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:45 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:45 user nova-compute[71689]:       <target dev="tap526282d7-c5"/>
Apr 14 17:07:45 user nova-compute[71689]:     </interface>
Apr 14 17:07:45 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:07:45 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/console.log" append="off"/>
Apr 14 17:07:45 user nova-compute[71689]:     </serial>
Apr 14 17:07:45 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:07:45 user nova-compute[71689]:     <video>
Apr 14 17:07:45 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:45 user nova-compute[71689]:     </video>
Apr 14 17:07:45 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:07:45 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:07:45 user nova-compute[71689]:     </rng>
Apr 14 17:07:45 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:07:45 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:07:45 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:07:45 user nova-compute[71689]:     </memballoon>
Apr 14 17:07:45 user nova-compute[71689]:   </devices>
Apr 14 17:07:45 user nova-compute[71689]: </domain>
Apr 14 17:07:45 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:07:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance destroyed successfully.
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] No VIF found with MAC fa:16:3e:c3:f6:95, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:07:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:47 user nova-compute[71689]: WARNING nova.compute.manager [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state active and task_state rescuing.
Apr 14 17:07:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:47 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492052.5855017, 3469a45b-e63a-4871-a6c5-deece7f4ecfd => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:47 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] VM Stopped (Lifecycle Event)
Apr 14 17:07:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b8a28f9d-7849-4469-9e79-2151d724ad1d None None] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:49 user nova-compute[71689]: WARNING nova.compute.manager [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state active and task_state rescuing.
Apr 14 17:07:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for d5920661-9030-4cf7-88a0-1ad789eec1bd due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492069.5741239, d5920661-9030-4cf7-88a0-1ad789eec1bd => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:49 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Resumed (Lifecycle Event)
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:49 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492069.5751765, d5920661-9030-4cf7-88a0-1ad789eec1bd => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:49 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Started (Lifecycle Event)
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:07:51 user nova-compute[71689]: INFO nova.compute.claims [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Claim successful on node user
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:07:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.policy [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:07:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Creating image(s)
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "/opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk 1073741824" returned: 0 in 0.059s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Successfully created port: 4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Cannot resize image /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'migration_context' on Instance uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Ensure instance console log exists: /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Successfully updated port: 4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received event network-changed-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Refreshing instance network info cache due to event network-changed-4ca35158-a3a3-41be-bfea-28f8bf46a796. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Acquiring lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updating instance_info_cache with network_info: [{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Instance network_info: |[{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Acquired lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.neutron [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Refreshing network info cache for port 4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Start _get_guest_xml network_info=[{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:07:53 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:53 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181691319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181691319',id=15,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-pne0ekse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:52Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'pci_devices' on Instance uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:07:53 user nova-compute[71689]:   <uuid>4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f</uuid>
Apr 14 17:07:53 user nova-compute[71689]:   <name>instance-0000000f</name>
Apr 14 17:07:53 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:07:53 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:07:53 user nova-compute[71689]:   <metadata>
Apr 14 17:07:53 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:07:53 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:07:53 user nova-compute[71689]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-181691319</nova:name>
Apr 14 17:07:53 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:07:53</nova:creationTime>
Apr 14 17:07:53 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:07:53 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:07:53 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:07:53 user nova-compute[71689]:       <nova:owner>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:user uuid="b5c86125160643958349100fb3a7855b">tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member</nova:user>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:project uuid="965bd22f61df40bd89e8ef35fb12bcd3">tempest-ServerBootFromVolumeStableRescueTest-995212803</nova:project>
Apr 14 17:07:53 user nova-compute[71689]:       </nova:owner>
Apr 14 17:07:53 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:07:53 user nova-compute[71689]:       <nova:ports>
Apr 14 17:07:53 user nova-compute[71689]:         <nova:port uuid="4ca35158-a3a3-41be-bfea-28f8bf46a796">
Apr 14 17:07:53 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 17:07:53 user nova-compute[71689]:         </nova:port>
Apr 14 17:07:53 user nova-compute[71689]:       </nova:ports>
Apr 14 17:07:53 user nova-compute[71689]:     </nova:instance>
Apr 14 17:07:53 user nova-compute[71689]:   </metadata>
Apr 14 17:07:53 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:07:53 user nova-compute[71689]:     <system>
Apr 14 17:07:53 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:07:53 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:07:53 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:07:53 user nova-compute[71689]:       <entry name="serial">4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f</entry>
Apr 14 17:07:53 user nova-compute[71689]:       <entry name="uuid">4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f</entry>
Apr 14 17:07:53 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:07:53 user nova-compute[71689]:     </system>
Apr 14 17:07:53 user nova-compute[71689]:   </sysinfo>
Apr 14 17:07:53 user nova-compute[71689]:   <os>
Apr 14 17:07:53 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:07:53 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:07:53 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:07:53 user nova-compute[71689]:   </os>
Apr 14 17:07:53 user nova-compute[71689]:   <features>
Apr 14 17:07:53 user nova-compute[71689]:     <acpi/>
Apr 14 17:07:53 user nova-compute[71689]:     <apic/>
Apr 14 17:07:53 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:07:53 user nova-compute[71689]:   </features>
Apr 14 17:07:53 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:07:53 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:07:53 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:07:53 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:07:53 user nova-compute[71689]:   </clock>
Apr 14 17:07:53 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:07:53 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:07:53 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:07:53 user nova-compute[71689]:   </cpu>
Apr 14 17:07:53 user nova-compute[71689]:   <devices>
Apr 14 17:07:53 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:07:53 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:07:53 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk"/>
Apr 14 17:07:53 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:07:53 user nova-compute[71689]:     </disk>
Apr 14 17:07:53 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:07:53 user nova-compute[71689]:       <mac address="fa:16:3e:d8:2f:e4"/>
Apr 14 17:07:53 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:53 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:07:53 user nova-compute[71689]:       <target dev="tap4ca35158-a3"/>
Apr 14 17:07:53 user nova-compute[71689]:     </interface>
Apr 14 17:07:53 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:07:53 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/console.log" append="off"/>
Apr 14 17:07:53 user nova-compute[71689]:     </serial>
Apr 14 17:07:53 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:07:53 user nova-compute[71689]:     <video>
Apr 14 17:07:53 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:07:53 user nova-compute[71689]:     </video>
Apr 14 17:07:53 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:07:53 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:07:53 user nova-compute[71689]:     </rng>
Apr 14 17:07:53 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:07:53 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:07:53 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:07:53 user nova-compute[71689]:     </memballoon>
Apr 14 17:07:53 user nova-compute[71689]:   </devices>
Apr 14 17:07:53 user nova-compute[71689]: </domain>
Apr 14 17:07:53 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181691319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181691319',id=15,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-pne0ekse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:07:52Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG os_vif [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ca35158-a3, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ca35158-a3, col_values=(('external_ids', {'iface-id': '4ca35158-a3a3-41be-bfea-28f8bf46a796', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:2f:e4', 'vm-uuid': '4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:53 user nova-compute[71689]: INFO os_vif [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3')
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:07:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No VIF found with MAC fa:16:3e:d8:2f:e4, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:07:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:54 user nova-compute[71689]: DEBUG nova.network.neutron [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updated VIF entry in instance network info cache for port 4ca35158-a3a3-41be-bfea-28f8bf46a796. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:07:54 user nova-compute[71689]: DEBUG nova.network.neutron [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updating instance_info_cache with network_info: [{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:07:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Releasing lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received event network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] No waiting events found dispatching network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:55 user nova-compute[71689]: WARNING nova.compute.manager [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received unexpected event network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance with vm_state building and task_state spawning.
Apr 14 17:07:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received event network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] No waiting events found dispatching network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:07:57 user nova-compute[71689]: WARNING nova.compute.manager [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received unexpected event network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance with vm_state building and task_state spawning.
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492077.8705542, 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:57 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] VM Resumed (Lifecycle Event)
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:07:57 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Instance spawned successfully.
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:07:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:07:58 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492077.8795323, 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:07:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] VM Started (Lifecycle Event)
Apr 14 17:07:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:07:58 user nova-compute[71689]: INFO nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Took 6.46 seconds to spawn the instance on the hypervisor.
Apr 14 17:07:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:07:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:07:58 user nova-compute[71689]: INFO nova.compute.manager [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Took 7.27 seconds to build instance.
Apr 14 17:07:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.373s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:07:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:07:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:08:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:08:15 user nova-compute[71689]: INFO nova.compute.claims [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Claim successful on node user
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:08:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.policy [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:08:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Creating image(s)
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.160s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk 1073741824" returned: 0 in 0.098s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Cannot resize image /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'migration_context' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Ensure instance console log exists: /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:18 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Successfully created port: de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:08:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Successfully updated port: de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-changed-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Refreshing instance network info cache due to event network-changed-de268504-352a-4d08-8113-a2098b794478. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance network_info: |[{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.neutron [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Refreshing network info cache for port de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start _get_guest_xml network_info=[{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:19 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:08:19 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-253960403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_devices' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:08:19 user nova-compute[71689]:   <uuid>84c02556-abf7-4832-a1b2-a2c28a7f8e52</uuid>
Apr 14 17:08:19 user nova-compute[71689]:   <name>instance-00000010</name>
Apr 14 17:08:19 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:08:19 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:08:19 user nova-compute[71689]:   <metadata>
Apr 14 17:08:19 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:08:19 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:08:19 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-253960403</nova:name>
Apr 14 17:08:19 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:08:19</nova:creationTime>
Apr 14 17:08:19 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:08:19 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:08:19 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:08:19 user nova-compute[71689]:       <nova:owner>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:08:19 user nova-compute[71689]:       </nova:owner>
Apr 14 17:08:19 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:08:19 user nova-compute[71689]:       <nova:ports>
Apr 14 17:08:19 user nova-compute[71689]:         <nova:port uuid="de268504-352a-4d08-8113-a2098b794478">
Apr 14 17:08:19 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:08:19 user nova-compute[71689]:         </nova:port>
Apr 14 17:08:19 user nova-compute[71689]:       </nova:ports>
Apr 14 17:08:19 user nova-compute[71689]:     </nova:instance>
Apr 14 17:08:19 user nova-compute[71689]:   </metadata>
Apr 14 17:08:19 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:08:19 user nova-compute[71689]:     <system>
Apr 14 17:08:19 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:08:19 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:08:19 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:08:19 user nova-compute[71689]:       <entry name="serial">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:08:19 user nova-compute[71689]:       <entry name="uuid">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:08:19 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:08:19 user nova-compute[71689]:     </system>
Apr 14 17:08:19 user nova-compute[71689]:   </sysinfo>
Apr 14 17:08:19 user nova-compute[71689]:   <os>
Apr 14 17:08:19 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:08:19 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:08:19 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:08:19 user nova-compute[71689]:   </os>
Apr 14 17:08:19 user nova-compute[71689]:   <features>
Apr 14 17:08:19 user nova-compute[71689]:     <acpi/>
Apr 14 17:08:19 user nova-compute[71689]:     <apic/>
Apr 14 17:08:19 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:08:19 user nova-compute[71689]:   </features>
Apr 14 17:08:19 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:08:19 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:08:19 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:08:19 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:08:19 user nova-compute[71689]:   </clock>
Apr 14 17:08:19 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:08:19 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:08:19 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:08:19 user nova-compute[71689]:   </cpu>
Apr 14 17:08:19 user nova-compute[71689]:   <devices>
Apr 14 17:08:19 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:08:19 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:08:19 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk"/>
Apr 14 17:08:19 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:08:19 user nova-compute[71689]:     </disk>
Apr 14 17:08:19 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:08:19 user nova-compute[71689]:       <mac address="fa:16:3e:0a:01:98"/>
Apr 14 17:08:19 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:08:19 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:08:19 user nova-compute[71689]:       <target dev="tapde268504-35"/>
Apr 14 17:08:19 user nova-compute[71689]:     </interface>
Apr 14 17:08:19 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:08:19 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log" append="off"/>
Apr 14 17:08:19 user nova-compute[71689]:     </serial>
Apr 14 17:08:19 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:08:19 user nova-compute[71689]:     <video>
Apr 14 17:08:19 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:08:19 user nova-compute[71689]:     </video>
Apr 14 17:08:19 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:08:19 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:08:19 user nova-compute[71689]:     </rng>
Apr 14 17:08:19 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:08:19 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:08:19 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:08:19 user nova-compute[71689]:     </memballoon>
Apr 14 17:08:19 user nova-compute[71689]:   </devices>
Apr 14 17:08:19 user nova-compute[71689]: </domain>
Apr 14 17:08:19 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-253960403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG os_vif [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde268504-35, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde268504-35, col_values=(('external_ids', {'iface-id': 'de268504-352a-4d08-8113-a2098b794478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:01:98', 'vm-uuid': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:19 user nova-compute[71689]: INFO os_vif [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:08:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:0a:01:98, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG nova.network.neutron [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updated VIF entry in instance network info cache for port de268504-352a-4d08-8113-a2098b794478. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG nova.network.neutron [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:08:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:21 user nova-compute[71689]: WARNING nova.compute.manager [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state building and task_state spawning.
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:23 user nova-compute[71689]: WARNING nova.compute.manager [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state building and task_state spawning.
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492103.663661, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Resumed (Lifecycle Event)
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance spawned successfully.
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.compute.manager [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Detaching volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492103.664508, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Started (Lifecycle Event)
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Took 7.14 seconds to spawn the instance on the hypervisor.
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.virt.block_device [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Attempting to driver detach volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb from mountpoint /dev/vdb
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Attempting to detach device vdb from instance c0488788-7b88-4c48-9fcd-02640c09feb1 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:08:23 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:08:23 user nova-compute[71689]:   <source dev="/dev/sdg"/>
Apr 14 17:08:23 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:08:23 user nova-compute[71689]:   <serial>58c68d43-05ee-458b-b7d0-8bc859d6ebcb</serial>
Apr 14 17:08:23 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:08:23 user nova-compute[71689]: </disk>
Apr 14 17:08:23 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:08:23 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully detached device vdb from instance c0488788-7b88-4c48-9fcd-02640c09feb1 from the persistent domain config.
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0488788-7b88-4c48-9fcd-02640c09feb1 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:08:23 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:08:23 user nova-compute[71689]:   <source dev="/dev/sdg"/>
Apr 14 17:08:23 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:08:23 user nova-compute[71689]:   <serial>58c68d43-05ee-458b-b7d0-8bc859d6ebcb</serial>
Apr 14 17:08:23 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:08:23 user nova-compute[71689]: </disk>
Apr 14 17:08:23 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: INFO nova.compute.manager [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Took 8.08 seconds to build instance.
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.187s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492104.3923264, c0488788-7b88-4c48-9fcd-02640c09feb1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:08:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully detached device vdb from instance c0488788-7b88-4c48-9fcd-02640c09feb1 from the live domain config.
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBlDqvpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:08:24 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8481318e-cfc0-45cb-b100-59165a5cd00d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:08:24 user nova-compute[71689]: No targets found.
Apr 14 17:08:24 user nova-compute[71689]: iSNS:
Apr 14 17:08:24 user nova-compute[71689]: No targets found.
Apr 14 17:08:24 user nova-compute[71689]: STATIC:
Apr 14 17:08:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:08:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:08:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:08:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb
Apr 14 17:08:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:08:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:08:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:08:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:08:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:08:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1
Apr 14 17:08:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:08:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:08:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6
Apr 14 17:08:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:08:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:08:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8
Apr 14 17:08:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:08:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:08:24 user nova-compute[71689]: FIRMWARE:
Apr 14 17:08:24 user nova-compute[71689]: No targets found.
Apr 14 17:08:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:08:24 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:08:24 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbc7f6a-3f8b-4828-b6b9-bd4bbc0054b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f57cac-8f34-42f6-a8a8-58b376fa4612]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:08:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:08:24 user nova-compute[71689]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb (non-flash)
Apr 14 17:08:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c1f5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb'): ({'sdg'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Removing single pathed devices sdg {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac533f9b-a790-4604-9de0-3f23540fcad7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[810670a3-1b82-4311-9529-8351858bd09c]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flushing IO for device /dev/sdg {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7786a-c5cf-4cfc-9861-f50dc42a08ef]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eebd439-d6af-460a-991d-6506673b0750]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] SCSI volumes sdg have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c513d5-0bd5-4b68-bd85-f5d50fe67407]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:08:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c4714e-5aa1-40d3-8e6f-900331ac5e38]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260]
Apr 14 17:08:25 user nova-compute[71689]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb, portal: 172.16.0.220,3260] successful.
Apr 14 17:08:25 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:25 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:08:25 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7778MB free_disk=26.481521606445312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58c68d43-05ee-458b-b7d0-8bc859d6ebcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf02d80-edd4-4fb0-a8f5-b9f6a99a107f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.952s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== disconnect_volume: return (954ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c0488788-7b88-4c48-9fcd-02640c09feb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance fb079a50-7726-4957-b853-d10c7cba46fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:08:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:26 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:08:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.603s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:08:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:08:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:08:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:08:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updating instance_info_cache with network_info: [{"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-add03bde-bc0e-436a-a994-e81c3f75e4c4" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:08:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:08:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:08:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:08:37 user nova-compute[71689]: INFO nova.compute.claims [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Claim successful on node user
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:08:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.policy [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:08:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Creating image(s)
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk 1073741824" returned: 0 in 0.054s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.168s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Successfully created port: f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Cannot resize image /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'migration_context' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Ensure instance console log exists: /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Successfully updated port: f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing instance network info cache due to event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance network_info: |[{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.neutron [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Start _get_guest_xml network_info=[{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:08:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:08:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-955558461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-955558461',id=17,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJFC8aHWWcd1B2OKM8xgRJWOuubZu8WyhuvxCCUHyDbwuTPBWSPjT8SoG+9FRiu9oyr4dmhioU2TIDdW0FcVGzCucc3oP1Egh2HH6SxTaumSFKNLHUxywdDbLcwsw7FyA==',key_name='tempest-keypair-2086238855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-a0vbjsvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=a0fe02ed-b8cd-43ac-9210-d36e8c90de5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'pci_devices' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:08:39 user nova-compute[71689]:   <uuid>a0fe02ed-b8cd-43ac-9210-d36e8c90de5c</uuid>
Apr 14 17:08:39 user nova-compute[71689]:   <name>instance-00000011</name>
Apr 14 17:08:39 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:08:39 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:08:39 user nova-compute[71689]:   <metadata>
Apr 14 17:08:39 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:08:39 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:08:39 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-955558461</nova:name>
Apr 14 17:08:39 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:08:39</nova:creationTime>
Apr 14 17:08:39 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:08:39 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:08:39 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:08:39 user nova-compute[71689]:       <nova:owner>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:user uuid="6aa926d6cfc94b08a564404f95da5483">tempest-AttachVolumeShelveTestJSON-339689049-project-member</nova:user>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:project uuid="1ae1b41823a64cd0b1c1a1669ad202ec">tempest-AttachVolumeShelveTestJSON-339689049</nova:project>
Apr 14 17:08:39 user nova-compute[71689]:       </nova:owner>
Apr 14 17:08:39 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:08:39 user nova-compute[71689]:       <nova:ports>
Apr 14 17:08:39 user nova-compute[71689]:         <nova:port uuid="f606ba05-7c5e-4e88-94ed-a44a82cb8150">
Apr 14 17:08:39 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:08:39 user nova-compute[71689]:         </nova:port>
Apr 14 17:08:39 user nova-compute[71689]:       </nova:ports>
Apr 14 17:08:39 user nova-compute[71689]:     </nova:instance>
Apr 14 17:08:39 user nova-compute[71689]:   </metadata>
Apr 14 17:08:39 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:08:39 user nova-compute[71689]:     <system>
Apr 14 17:08:39 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:08:39 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:08:39 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:08:39 user nova-compute[71689]:       <entry name="serial">a0fe02ed-b8cd-43ac-9210-d36e8c90de5c</entry>
Apr 14 17:08:39 user nova-compute[71689]:       <entry name="uuid">a0fe02ed-b8cd-43ac-9210-d36e8c90de5c</entry>
Apr 14 17:08:39 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:08:39 user nova-compute[71689]:     </system>
Apr 14 17:08:39 user nova-compute[71689]:   </sysinfo>
Apr 14 17:08:39 user nova-compute[71689]:   <os>
Apr 14 17:08:39 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:08:39 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:08:39 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:08:39 user nova-compute[71689]:   </os>
Apr 14 17:08:39 user nova-compute[71689]:   <features>
Apr 14 17:08:39 user nova-compute[71689]:     <acpi/>
Apr 14 17:08:39 user nova-compute[71689]:     <apic/>
Apr 14 17:08:39 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:08:39 user nova-compute[71689]:   </features>
Apr 14 17:08:39 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:08:39 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:08:39 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:08:39 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:08:39 user nova-compute[71689]:   </clock>
Apr 14 17:08:39 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:08:39 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:08:39 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:08:39 user nova-compute[71689]:   </cpu>
Apr 14 17:08:39 user nova-compute[71689]:   <devices>
Apr 14 17:08:39 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:08:39 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:08:39 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk"/>
Apr 14 17:08:39 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:08:39 user nova-compute[71689]:     </disk>
Apr 14 17:08:39 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:08:39 user nova-compute[71689]:       <mac address="fa:16:3e:36:f6:67"/>
Apr 14 17:08:39 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:08:39 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:08:39 user nova-compute[71689]:       <target dev="tapf606ba05-7c"/>
Apr 14 17:08:39 user nova-compute[71689]:     </interface>
Apr 14 17:08:39 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:08:39 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/console.log" append="off"/>
Apr 14 17:08:39 user nova-compute[71689]:     </serial>
Apr 14 17:08:39 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:08:39 user nova-compute[71689]:     <video>
Apr 14 17:08:39 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:08:39 user nova-compute[71689]:     </video>
Apr 14 17:08:39 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:08:39 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:08:39 user nova-compute[71689]:     </rng>
Apr 14 17:08:39 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:08:39 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:08:39 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:08:39 user nova-compute[71689]:     </memballoon>
Apr 14 17:08:39 user nova-compute[71689]:   </devices>
Apr 14 17:08:39 user nova-compute[71689]: </domain>
Apr 14 17:08:39 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-955558461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-955558461',id=17,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJFC8aHWWcd1B2OKM8xgRJWOuubZu8WyhuvxCCUHyDbwuTPBWSPjT8SoG+9FRiu9oyr4dmhioU2TIDdW0FcVGzCucc3oP1Egh2HH6SxTaumSFKNLHUxywdDbLcwsw7FyA==',key_name='tempest-keypair-2086238855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-a0vbjsvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=a0fe02ed-b8cd-43ac-9210-d36e8c90de5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG os_vif [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf606ba05-7c, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf606ba05-7c, col_values=(('external_ids', {'iface-id': 'f606ba05-7c5e-4e88-94ed-a44a82cb8150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f6:67', 'vm-uuid': 'a0fe02ed-b8cd-43ac-9210-d36e8c90de5c'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:39 user nova-compute[71689]: INFO os_vif [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c')
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:08:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No VIF found with MAC fa:16:3e:36:f6:67, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:08:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updated VIF entry in instance network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:08:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:41 user nova-compute[71689]: WARNING nova.compute.manager [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state building and task_state spawning.
Apr 14 17:08:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492123.5216298, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] VM Resumed (Lifecycle Event)
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance spawned successfully.
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492123.5230794, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] VM Started (Lifecycle Event)
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Took 5.83 seconds to spawn the instance on the hypervisor.
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Took 6.64 seconds to build instance.
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.755s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:43 user nova-compute[71689]: WARNING nova.compute.manager [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state active and task_state None.
Apr 14 17:08:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Terminating instance
Apr 14 17:08:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Instance destroyed successfully.
Apr 14 17:08:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'resources' on Instance uuid 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1952305466',display_name='tempest-VolumesAdminNegativeTest-server-1952305466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1952305466',id=13,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c8f41946e544d0c93cbceb3d03e50a5',ramdisk_id='',reservation_id='r-dmhf42gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2070911352',owner_user_name='tempest-VolumesAdminNegativeTest-2070911352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:06:53Z,user_data=None,user_id='01d0e8ec192748edbe2576ef1c1e1cb5',uuid=8c51fc1f-dcf6-4c42-8a4f-4b489c270895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converting VIF {"id": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "address": "fa:16:3e:df:7c:ed", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179579bb-9a", "ovs_interfaceid": "179579bb-9a96-4128-bdc5-35cbeca29ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG os_vif [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap179579bb-9a, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:08:44 user nova-compute[71689]: INFO os_vif [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7c:ed,bridge_name='br-int',has_traffic_filtering=True,id=179579bb-9a96-4128-bdc5-35cbeca29ff5,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179579bb-9a')
Apr 14 17:08:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Deleting instance files /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895_del
Apr 14 17:08:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Deletion of /opt/stack/data/nova/instances/8c51fc1f-dcf6-4c42-8a4f-4b489c270895_del complete
Apr 14 17:08:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 14 17:08:44 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:08:44 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:45 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Took 0.49 seconds to deallocate network for instance.
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received event network-vif-deleted-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:45 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Deleted allocations for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.704s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received event network-vif-unplugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] No waiting events found dispatching network-vif-unplugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:45 user nova-compute[71689]: WARNING nova.compute.manager [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received unexpected event network-vif-unplugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance with vm_state deleted and task_state None.
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received event network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Acquiring lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Lock "8c51fc1f-dcf6-4c42-8a4f-4b489c270895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] No waiting events found dispatching network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:45 user nova-compute[71689]: WARNING nova.compute.manager [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Received unexpected event network-vif-plugged-179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance with vm_state deleted and task_state None.
Apr 14 17:08:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-changed-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing instance network info cache due to event network-changed-ae212ee6-7785-475c-a4cf-1014775b96a5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Acquiring lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Acquired lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG nova.network.neutron [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Refreshing network info cache for port ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG nova.network.neutron [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updated VIF entry in instance network info cache for port ae212ee6-7785-475c-a4cf-1014775b96a5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG nova.network.neutron [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [{"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:08:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Releasing lock "refresh_cache-fb079a50-7726-4957-b853-d10c7cba46fb" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:08:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "fb079a50-7726-4957-b853-d10c7cba46fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:58 user nova-compute[71689]: INFO nova.compute.manager [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Terminating instance
Apr 14 17:08:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-ae212ee6-7785-475c-a4cf-1014775b96a5 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492124.5276022, 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:08:59 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] VM Stopped (Lifecycle Event)
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b54fab45-e7cd-447c-903b-d192caa6f4bb None None] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:08:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Instance destroyed successfully.
Apr 14 17:09:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lazy-loading 'resources' on Instance uuid fb079a50-7726-4957-b853-d10c7cba46fb {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "ae212ee6-7785-475c-a4cf-1014775b96a5", "address": "fa:16:3e:84:8e:20", "network": {"id": "b3b8775c-102b-4f49-9cd6-b1e385565e09", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1865245915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae212ee6-77", "ovs_interfaceid": "ae212ee6-7785-475c-a4cf-1014775b96a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae212ee6-77, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:20,bridge_name='br-int',has_traffic_filtering=True,id=ae212ee6-7785-475c-a4cf-1014775b96a5,network=Network(b3b8775c-102b-4f49-9cd6-b1e385565e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae212ee6-77')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac7ba708-31, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:aa:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac7ba708-31ec-460a-bcad-14c6b7fb2bea,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac7ba708-31')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc88a2f62-0f, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:00:a9,bridge_name='br-int',has_traffic_filtering=True,id=c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc88a2f62-0f')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf8c94dd-89, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=af8c94dd-8947-4377-b332-64f1da7f7ea6,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c94dd-89')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd98ca06a-32, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:37:8f,bridge_name='br-int',has_traffic_filtering=True,id=d98ca06a-3268-4d34-9fe9-524860935952,network=Network(ed0dc547-859c-44ef-95df-88a745ef50fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98ca06a-32')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ecf5b01-50, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=0ecf5b01-5002-45ce-95cb-730296ee6817,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecf5b01-50')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T17:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-703690354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-703690354',id=14,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g==',key_name='tempest-keypair-635785217',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='447e75d0cc144b9ab741d8591af3959e',ramdisk_id='',reservation_id='r-s8k0k6cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-195680184',owner_user_name='tempest-TaggedBootDevicesTest_v242-195680184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef6f58f76314333b233365266ef5c57',uuid=fb079a50-7726-4957-b853-d10c7cba46fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converting VIF {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d71284-fb, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:01 user nova-compute[71689]: INFO os_vif [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:62:6a,bridge_name='br-int',has_traffic_filtering=True,id=84d71284-fb7a-4263-8388-5526e6d4e033,network=Network(7312f6ad-9ca1-4e12-9d54-eecaedf53aa5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d71284-fb')
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXfcbwxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b7b9bf-7907-438b-a465-b59307c2c155]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]: iSNS:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]: STATIC:
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: FIRMWARE:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:09:01 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:09:01 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac0da4-00ff-4a4f-b1f8-72e49bc9186d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a912d-98f4-4477-bc64-5fa9fd2d1512]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b59474ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b6eb17-b72a-4146-9e30-faf7c7733221]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a40b9ec-7b0a-4fd9-b6a8-1407b8fe77a0]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e343b45-41a0-42ff-bfca-8ceb4bd7525a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-ae212ee6-7785-475c-a4cf-1014775b96a5 for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-84d71284-fb7a-4263-8388-5526e6d4e033 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-84d71284-fb7a-4263-8388-5526e6d4e033 for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cef71c-a940-4a3a-9270-dffb34b73b0d]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e951ca1-96a9-4c91-b432-e8a03cb4cef2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f1f98-9ad3-4ba7-93d6-9a6bb73cc066]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260]
Apr 14 17:09:01 user nova-compute[71689]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1, portal: 172.16.0.220,3260] successful.
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c124c18-317b-4292-9e62-828a770d71d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1826bb5-7591-4765-bfa8-5046646f7998]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== disconnect_volume: return (302ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqNfMJiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-d98ca06a-3268-4d34-9fe9-524860935952 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-d98ca06a-3268-4d34-9fe9-524860935952 for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-unplugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-unplugged-0ecf5b01-5002-45ce-95cb-730296ee6817 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "fb079a50-7726-4957-b853-d10c7cba46fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] No waiting events found dispatching network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING nova.compute.manager [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received unexpected event network-vif-plugged-0ecf5b01-5002-45ce-95cb-730296ee6817 for instance with vm_state active and task_state deleting.
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a21dec-809e-4baf-9400-59de4bf438cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]: iSNS:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]: STATIC:
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: FIRMWARE:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:09:01 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:09:01 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eed9ab-195a-472b-ad57-2ac7ad81b364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[94338723-90e9-4b9e-a05e-2d649390650f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c0ba4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a566a8f3-129d-4f02-ace8-a2d9d265ebc0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d01535-a336-4301-83a5-a8764db5dc27]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd68194-774f-47f4-ae5a-64311a081fb4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426ba20-9332-4c76-8660-190f20ed7adf]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[214cbb53-2424-4bb0-932c-0378dafe6478]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d00e84d-70ce-4c00-8964-00484bc48416]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260]
Apr 14 17:09:01 user nova-compute[71689]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8, portal: 172.16.0.220,3260] successful.
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed99bca-7d21-4bc3-a44b-7ff5945370c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c85de-4a1d-4bf7-99ff-2dd69daea600]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== disconnect_volume: return (310ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoAnHmSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:09:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a0806-1c26-416e-8ffc-36015ed6bc0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]: iSNS:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]: STATIC:
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6
Apr 14 17:09:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:01 user nova-compute[71689]: FIRMWARE:
Apr 14 17:09:01 user nova-compute[71689]: No targets found.
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:09:01 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:09:01 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fbf622-e891-4bd0-8448-aab194c46943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[609daece-9796-4989-8146-5f8f9b044390]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c0ba4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fd62ae-d79c-460c-95af-f8862bca7ce0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042668d-7ea2-46b9-8c9f-6693a46280ab]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4396b3ab-cfba-4c72-9a9d-4bead330b3dd]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fed7ab-987d-45c0-b3e9-2884e0da1478]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3880946c-90fa-441c-a996-5e7d1d06feef]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b5aacd-4abc-4ada-9632-61514a64a468]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260]
Apr 14 17:09:02 user nova-compute[71689]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6, portal: 172.16.0.220,3260] successful.
Apr 14 17:09:02 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0f18d8-07b9-41ce-a064-e0d321058ef6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8f2b11-9c6c-4a39-801d-6f94aea336af]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] <== disconnect_volume: return (276ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:09:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Deleting instance files /opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb_del
Apr 14 17:09:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Deletion of /opt/stack/data/nova/instances/fb079a50-7726-4957-b853-d10c7cba46fb_del complete
Apr 14 17:09:02 user nova-compute[71689]: INFO nova.compute.manager [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Took 3.28 seconds to destroy the instance on the hypervisor.
Apr 14 17:09:02 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:09:02 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:09:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-deleted-ae212ee6-7785-475c-a4cf-1014775b96a5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:04 user nova-compute[71689]: INFO nova.compute.manager [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Neutron deleted interface ae212ee6-7785-475c-a4cf-1014775b96a5; detaching it from the instance and deleting it from the info cache
Apr 14 17:09:04 user nova-compute[71689]: DEBUG nova.network.neutron [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [{"id": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "address": "fa:16:3e:d0:aa:b7", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7ba708-31", "ovs_interfaceid": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "address": "fa:16:3e:2d:00:a9", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88a2f62-0f", "ovs_interfaceid": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "address": "fa:16:3e:42:80:e8", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c94dd-89", "ovs_interfaceid": "af8c94dd-8947-4377-b332-64f1da7f7ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d98ca06a-3268-4d34-9fe9-524860935952", "address": "fa:16:3e:17:37:8f", "network": {"id": "ed0dc547-859c-44ef-95df-88a745ef50fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-520492184", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98ca06a-32", "ovs_interfaceid": "d98ca06a-3268-4d34-9fe9-524860935952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ecf5b01-5002-45ce-95cb-730296ee6817", "address": "fa:16:3e:90:06:c6", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecf5b01-50", "ovs_interfaceid": "0ecf5b01-5002-45ce-95cb-730296ee6817", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d71284-fb7a-4263-8388-5526e6d4e033", "address": "fa:16:3e:db:62:6a", "network": {"id": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846661100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "447e75d0cc144b9ab741d8591af3959e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d71284-fb", "ovs_interfaceid": "84d71284-fb7a-4263-8388-5526e6d4e033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Detach interface failed, port_id=ae212ee6-7785-475c-a4cf-1014775b96a5, reason: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:09:06 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:06 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Took 3.83 seconds to deallocate network for instance.
Apr 14 17:09:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-deleted-af8c94dd-8947-4377-b332-64f1da7f7ea6 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-deleted-84d71284-fb7a-4263-8388-5526e6d4e033 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-deleted-d98ca06a-3268-4d34-9fe9-524860935952 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Received event network-vif-deleted-0ecf5b01-5002-45ce-95cb-730296ee6817 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:08 user nova-compute[71689]: INFO nova.compute.manager [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Took 2.37 seconds to detach 3 volumes for instance.
Apr 14 17:09:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:08 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:09:08 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:09:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:08 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Deleted allocations for instance fb079a50-7726-4957-b853-d10c7cba46fb
Apr 14 17:09:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "fb079a50-7726-4957-b853-d10c7cba46fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.949s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:14 user nova-compute[71689]: INFO nova.compute.manager [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Terminating instance
Apr 14 17:09:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-vif-unplugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] No waiting events found dispatching network-vif-unplugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-vif-unplugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Instance destroyed successfully.
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'resources' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-304489661',display_name='tempest-AttachVolumeNegativeTest-server-304489661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-304489661',id=2,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMFX3PNhmn48zAcAM32FCi6I37xeoBXmvNkQF9+BlyxoC3Wt0VKiGtT8+ZV4F3wVaRtE4tHpycwzfuy8U0QMx+VsAblObJ2Jwl7GhaAEZfytnLGzIAsPxYRqQiYBh5Ikg==',key_name='tempest-keypair-425177179',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-9c3g4xq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=c0488788-7b88-4c48-9fcd-02640c09feb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "address": "fa:16:3e:70:b7:23", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6bafa-17", "ovs_interfaceid": "adb6bafa-17f9-4c4e-af68-632cc59c3a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG os_vif [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadb6bafa-17, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:15 user nova-compute[71689]: INFO os_vif [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=adb6bafa-17f9-4c4e-af68-632cc59c3a03,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6bafa-17')
Apr 14 17:09:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Deleting instance files /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1_del
Apr 14 17:09:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Deletion of /opt/stack/data/nova/instances/c0488788-7b88-4c48-9fcd-02640c09feb1_del complete
Apr 14 17:09:15 user nova-compute[71689]: INFO nova.compute.manager [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Took 1.03 seconds to destroy the instance on the hypervisor.
Apr 14 17:09:15 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:15 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Took 0.73 seconds to deallocate network for instance.
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492140.9086897, fb079a50-7726-4957-b853-d10c7cba46fb => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:09:15 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] VM Stopped (Lifecycle Event)
Apr 14 17:09:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-313c927d-d5d0-42b2-8e2f-b53a432a1806 None None] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:16 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Deleted allocations for instance c0488788-7b88-4c48-9fcd-02640c09feb1
Apr 14 17:09:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Acquiring lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Lock "c0488788-7b88-4c48-9fcd-02640c09feb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] No waiting events found dispatching network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:16 user nova-compute[71689]: WARNING nova.compute.manager [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received unexpected event network-vif-plugged-adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance with vm_state deleted and task_state None.
Apr 14 17:09:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Received event network-vif-deleted-adb6bafa-17f9-4c4e-af68-632cc59c3a03 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:18 user nova-compute[71689]: INFO nova.compute.manager [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Detaching volume 7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:09:18 user nova-compute[71689]: INFO nova.virt.block_device [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Attempting to driver detach volume 7ef40a58-0f55-4cad-9da8-5f08f9070aaf from mountpoint /dev/vdb
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Attempting to detach device vdb from instance d68b702a-a0dc-4030-9893-87b4ef44fb97 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:09:18 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:09:18 user nova-compute[71689]:   <source dev="/dev/sdb"/>
Apr 14 17:09:18 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:09:18 user nova-compute[71689]:   <serial>7ef40a58-0f55-4cad-9da8-5f08f9070aaf</serial>
Apr 14 17:09:18 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:09:18 user nova-compute[71689]: </disk>
Apr 14 17:09:18 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:09:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully detached device vdb from instance d68b702a-a0dc-4030-9893-87b4ef44fb97 from the persistent domain config.
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d68b702a-a0dc-4030-9893-87b4ef44fb97 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:09:18 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:09:18 user nova-compute[71689]:   <source dev="/dev/sdb"/>
Apr 14 17:09:18 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:09:18 user nova-compute[71689]:   <serial>7ef40a58-0f55-4cad-9da8-5f08f9070aaf</serial>
Apr 14 17:09:18 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:09:18 user nova-compute[71689]: </disk>
Apr 14 17:09:18 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492158.941809, d68b702a-a0dc-4030-9893-87b4ef44fb97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:09:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully detached device vdb from instance d68b702a-a0dc-4030-9893-87b4ef44fb97 from the live domain config.
Apr 14 17:09:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjabkIdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:09:18 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:09:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9348585-f183-416d-86da-1845d9ada75f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:09:18 user nova-compute[71689]: No targets found.
Apr 14 17:09:18 user nova-compute[71689]: iSNS:
Apr 14 17:09:18 user nova-compute[71689]: No targets found.
Apr 14 17:09:18 user nova-compute[71689]: STATIC:
Apr 14 17:09:18 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:09:18 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:18 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:18 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf
Apr 14 17:09:18 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:09:18 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:09:18 user nova-compute[71689]: FIRMWARE:
Apr 14 17:09:18 user nova-compute[71689]: No targets found.
Apr 14 17:09:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:09:18 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:09:18 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:09:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f63946-2d78-42f9-8a5a-4a48404d4a49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bfc695-edb2-4f52-b2b7-c69bb14c9bdf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:19 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:19 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf (non-flash)
Apr 14 17:09:19 user nova-compute[71689]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:09:19 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b59305d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda31fe-60cc-4ac6-800e-6938a2a02552]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b8fa3d-3468-42b7-b7b9-b3e520fdcefc]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[df696593-374f-41f3-b4a7-a160102cd733]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.081s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[802469ae-f8e0-467c-b13b-ee8b9dfe586b]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb1533e-8dd6-48db-aadb-a67444327369]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c41d1-1acc-4519-a0c6-92dadc8bc5d2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260]
Apr 14 17:09:19 user nova-compute[71689]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf, portal: 172.16.0.220,3260] successful.
Apr 14 17:09:19 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef40a58-0f55-4cad-9da8-5f08f9070aaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce92e0-749d-44bb-b301-e122e4722ec7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== disconnect_volume: return (348ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:09:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71689) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:21 user nova-compute[71689]: WARNING nova.compute.manager [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state active and task_state powering-off.
Apr 14 17:09:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:21 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance destroyed successfully.
Apr 14 17:09:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.859s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:23 user nova-compute[71689]: WARNING nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:23 user nova-compute[71689]: WARNING nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:23 user nova-compute[71689]: WARNING nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:23 user nova-compute[71689]: WARNING nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:23 user nova-compute[71689]: WARNING nova.compute.manager [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state None.
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:24 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:09:24 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=26.476913452148438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:09:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492155.0542386, c0488788-7b88-4c48-9fcd-02640c09feb1 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:09:30 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] VM Stopped (Lifecycle Event)
Apr 14 17:09:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f4bdedf2-98a0-4340-9d9c-8269142d267f None None] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:09:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:32 user nova-compute[71689]: INFO nova.compute.manager [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Unrescuing
Apr 14 17:09:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG nova.objects.instance [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'flavor' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:33 user nova-compute[71689]: WARNING nova.compute.manager [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:09:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance destroyed successfully.
Apr 14 17:09:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:35 user nova-compute[71689]: WARNING nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:09:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing instance network info cache due to event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG nova.network.neutron [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updated VIF entry in instance network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing instance network info cache due to event network-changed-526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Acquiring lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Acquired lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Refreshing network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492161.4973643, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:09:36 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Stopped (Lifecycle Event)
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4483b0ba-db88-4e9c-a5fe-4f215d350325 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4483b0ba-db88-4e9c-a5fe-4f215d350325 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updated VIF entry in instance network info cache for port 526282d7-c5ce-4ae0-9745-4e43477222f0. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [{"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Releasing lock "refresh_cache-d5920661-9030-4cf7-88a0-1ad789eec1bd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:37 user nova-compute[71689]: WARNING nova.compute.manager [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:37 user nova-compute[71689]: WARNING nova.compute.manager [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for d5920661-9030-4cf7-88a0-1ad789eec1bd due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492177.6573076, d5920661-9030-4cf7-88a0-1ad789eec1bd => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:09:37 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Resumed (Lifecycle Event)
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:09:37 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492177.6626632, d5920661-9030-4cf7-88a0-1ad789eec1bd => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:09:37 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Started (Lifecycle Event)
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:09:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:38 user nova-compute[71689]: INFO nova.compute.manager [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Terminating instance
Apr 14 17:09:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-unplugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-unplugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-unplugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Instance destroyed successfully.
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'resources' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-883128230',display_name='tempest-VolumesAdminNegativeTest-server-883128230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-883128230',id=6,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR1CNYcMSCZc5eqIUYpiiSdLTZSUbTWdwUiOhkSwjDpbWuIjOlJMXY2cpa5eWTlS2m8+qE/dME0iLvbqEAefO3EiObUhqvYCxqX/rY9WZyKZyz8bSdRk67t79mPKSlZeQ==',key_name='tempest-keypair-1620409315',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c8f41946e544d0c93cbceb3d03e50a5',ramdisk_id='',reservation_id='r-3owe8f5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2070911352',owner_user_name='tempest-VolumesAdminNegativeTest-2070911352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01d0e8ec192748edbe2576ef1c1e1cb5',uuid=add03bde-bc0e-436a-a994-e81c3f75e4c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converting VIF {"id": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "address": "fa:16:3e:a7:bb:57", "network": {"id": "6b1137c2-ea7b-406d-86c9-407c314c8247", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-400282656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8f41946e544d0c93cbceb3d03e50a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8968b4-33", "ovs_interfaceid": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG os_vif [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e8968b4-33, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: INFO os_vif [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:bb:57,bridge_name='br-int',has_traffic_filtering=True,id=0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488,network=Network(6b1137c2-ea7b-406d-86c9-407c314c8247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8968b4-33')
Apr 14 17:09:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Deleting instance files /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4_del
Apr 14 17:09:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Deletion of /opt/stack/data/nova/instances/add03bde-bc0e-436a-a994-e81c3f75e4c4_del complete
Apr 14 17:09:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:39 user nova-compute[71689]: INFO nova.compute.manager [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 17:09:39 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:09:39 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:09:41 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Took 1.34 seconds to deallocate network for instance.
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:41 user nova-compute[71689]: WARNING nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state deleted and task_state None.
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:41 user nova-compute[71689]: WARNING nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state deleted and task_state None.
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:41 user nova-compute[71689]: WARNING nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state deleted and task_state None.
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-unplugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-unplugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:41 user nova-compute[71689]: WARNING nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-unplugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state deleted and task_state None.
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Acquiring lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] No waiting events found dispatching network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:09:41 user nova-compute[71689]: WARNING nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received unexpected event network-vif-plugged-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance with vm_state deleted and task_state None.
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Received event network-vif-deleted-0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:41 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Deleted allocations for instance add03bde-bc0e-436a-a994-e81c3f75e4c4
Apr 14 17:09:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "add03bde-bc0e-436a-a994-e81c3f75e4c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:42 user nova-compute[71689]: INFO nova.compute.manager [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] instance snapshotting
Apr 14 17:09:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Beginning live snapshot process
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmpihx8y5/7250591c8ea5483699458ee01d6b420a.delta 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmpihx8y5/7250591c8ea5483699458ee01d6b420a.delta 1073741824" returned: 0 in 0.124s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 17:09:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:09:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:09:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 17:09:44 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:09:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmpihx8y5/7250591c8ea5483699458ee01d6b420a.delta /opt/stack/data/nova/instances/snapshots/tmpmpihx8y5/7250591c8ea5483699458ee01d6b420a {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:09:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmpihx8y5/7250591c8ea5483699458ee01d6b420a.delta /opt/stack/data/nova/instances/snapshots/tmpmpihx8y5/7250591c8ea5483699458ee01d6b420a" returned: 0 in 0.344s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:09:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Snapshot extracted, beginning image upload
Apr 14 17:09:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Snapshot image upload complete
Apr 14 17:09:46 user nova-compute[71689]: INFO nova.compute.manager [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Took 4.72 seconds to snapshot the instance on the hypervisor.
Apr 14 17:09:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:54 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492179.7142763, add03bde-bc0e-436a-a994-e81c3f75e4c4 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:09:54 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] VM Stopped (Lifecycle Event)
Apr 14 17:09:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-097f8c05-e7e9-421d-bb0d-f4ab9debccb0 None None] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:09:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 3ed9bc80-9e7d-4de9-ac86-704c927b111d {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:09:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:09:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:05 user nova-compute[71689]: INFO nova.compute.manager [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Detaching volume e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:10:05 user nova-compute[71689]: INFO nova.virt.block_device [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Attempting to driver detach volume e5dc56d4-d704-4e10-8ed6-33153ab29a68 from mountpoint /dev/vdb
Apr 14 17:10:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Attempting to detach device vdb from instance d5920661-9030-4cf7-88a0-1ad789eec1bd from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:10:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:10:05 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:10:05 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:10:05 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:10:05 user nova-compute[71689]:   <serial>e5dc56d4-d704-4e10-8ed6-33153ab29a68</serial>
Apr 14 17:10:05 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:10:05 user nova-compute[71689]: </disk>
Apr 14 17:10:05 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:10:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Successfully detached device vdb from instance d5920661-9030-4cf7-88a0-1ad789eec1bd from the persistent domain config.
Apr 14 17:10:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5920661-9030-4cf7-88a0-1ad789eec1bd from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:10:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:10:05 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:10:05 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:10:05 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:10:05 user nova-compute[71689]:   <serial>e5dc56d4-d704-4e10-8ed6-33153ab29a68</serial>
Apr 14 17:10:05 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:10:05 user nova-compute[71689]: </disk>
Apr 14 17:10:05 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492206.3590176, d5920661-9030-4cf7-88a0-1ad789eec1bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:10:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Successfully detached device vdb from instance d5920661-9030-4cf7-88a0-1ad789eec1bd from the live domain config.
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbBPYtXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:10:06 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f66660-7241-4136-8951-6100b4f4542f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:10:06 user nova-compute[71689]: No targets found.
Apr 14 17:10:06 user nova-compute[71689]: iSNS:
Apr 14 17:10:06 user nova-compute[71689]: No targets found.
Apr 14 17:10:06 user nova-compute[71689]: STATIC:
Apr 14 17:10:06 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68
Apr 14 17:10:06 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:10:06 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:10:06 user nova-compute[71689]: FIRMWARE:
Apr 14 17:10:06 user nova-compute[71689]: No targets found.
Apr 14 17:10:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:10:06 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:10:06 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab69f87-6166-4e91-9a6c-378d730b1cc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa245fbb-4bf5-4c29-9686-2cf313035f8c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:10:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 (non-flash)
Apr 14 17:10:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c3556c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68'): ({'sdf'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Removing single pathed devices sdf {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9b285-93f6-43a2-a4c3-0367fd30502c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1dea02-5f86-4f5a-af31-7b8c75fc698f]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flushing IO for device /dev/sdf {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3011c-d7ae-41e6-af49-85d81f5ec4bd]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e700ace7-4ed7-4940-8726-497940a1e6d6]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] SCSI volumes sdf have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76137356-79cf-495f-960b-2891de42b850]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef24d7-570c-4c14-87a5-c27257fc343b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260]
Apr 14 17:10:06 user nova-compute[71689]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68, portal: 172.16.0.220,3260] successful.
Apr 14 17:10:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5dc56d4-d704-4e10-8ed6-33153ab29a68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[11477780-4418-4d26-9c97-cfd53120fba8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] <== disconnect_volume: return (308ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-changed-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Refreshing instance network info cache due to event network-changed-de268504-352a-4d08-8113-a2098b794478. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:06 user nova-compute[71689]: DEBUG nova.network.neutron [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Refreshing network info cache for port de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'flavor' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:07 user nova-compute[71689]: DEBUG nova.network.neutron [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updated VIF entry in instance network info cache for port de268504-352a-4d08-8113-a2098b794478. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:10:07 user nova-compute[71689]: DEBUG nova.network.neutron [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.841s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:10:08 user nova-compute[71689]: INFO nova.compute.claims [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Claim successful on node user
Apr 14 17:10:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:10:08 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:10:08 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.policy [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:10:09 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Creating image(s)
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "/opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk 1073741824" returned: 0 in 0.049s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Cannot resize image /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'migration_context' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Ensure instance console log exists: /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:09 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Successfully created port: 84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Successfully updated port: 84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquired lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-changed-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Refreshing instance network info cache due to event network-changed-84d1f2c3-e095-4535-92c3-9ff189992179. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Acquiring lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updating instance_info_cache with network_info: [{"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Releasing lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Instance network_info: |[{"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Acquired lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.network.neutron [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Refreshing network info cache for port 84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Start _get_guest_xml network_info=[{"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:10:11 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:11 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-128880765',display_name='tempest-AttachVolumeNegativeTest-server-128880765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-128880765',id=18,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTdefih26p4VWLlEtU9B5X8kXev8KrkLhnDrViyCkzWshAjGw+6zUvio9aNibzsCRg3M8zqQXAtV/jSH9vT630W3rFV6Oo2EOMEB51kmqtYD1qr26uKQ8UwWYLpsALnQ==',key_name='tempest-keypair-2060261619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-mksdki93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=7213d0b2-6eac-449b-aa4b-44088686abac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'pci_devices' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:10:11 user nova-compute[71689]:   <uuid>7213d0b2-6eac-449b-aa4b-44088686abac</uuid>
Apr 14 17:10:11 user nova-compute[71689]:   <name>instance-00000012</name>
Apr 14 17:10:11 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:10:11 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:10:11 user nova-compute[71689]:   <metadata>
Apr 14 17:10:11 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:10:11 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:10:11 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeNegativeTest-server-128880765</nova:name>
Apr 14 17:10:11 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:10:11</nova:creationTime>
Apr 14 17:10:11 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:10:11 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:10:11 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:10:11 user nova-compute[71689]:       <nova:owner>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:user uuid="d9c9e0d318eb4ca49d47d620682fb00a">tempest-AttachVolumeNegativeTest-1177875221-project-member</nova:user>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:project uuid="6f341a2096b9483787b569a59f325556">tempest-AttachVolumeNegativeTest-1177875221</nova:project>
Apr 14 17:10:11 user nova-compute[71689]:       </nova:owner>
Apr 14 17:10:11 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:10:11 user nova-compute[71689]:       <nova:ports>
Apr 14 17:10:11 user nova-compute[71689]:         <nova:port uuid="84d1f2c3-e095-4535-92c3-9ff189992179">
Apr 14 17:10:11 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 17:10:11 user nova-compute[71689]:         </nova:port>
Apr 14 17:10:11 user nova-compute[71689]:       </nova:ports>
Apr 14 17:10:11 user nova-compute[71689]:     </nova:instance>
Apr 14 17:10:11 user nova-compute[71689]:   </metadata>
Apr 14 17:10:11 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:10:11 user nova-compute[71689]:     <system>
Apr 14 17:10:11 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:10:11 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:10:11 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:10:11 user nova-compute[71689]:       <entry name="serial">7213d0b2-6eac-449b-aa4b-44088686abac</entry>
Apr 14 17:10:11 user nova-compute[71689]:       <entry name="uuid">7213d0b2-6eac-449b-aa4b-44088686abac</entry>
Apr 14 17:10:11 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:10:11 user nova-compute[71689]:     </system>
Apr 14 17:10:11 user nova-compute[71689]:   </sysinfo>
Apr 14 17:10:11 user nova-compute[71689]:   <os>
Apr 14 17:10:11 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:10:11 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:10:11 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:10:11 user nova-compute[71689]:   </os>
Apr 14 17:10:11 user nova-compute[71689]:   <features>
Apr 14 17:10:11 user nova-compute[71689]:     <acpi/>
Apr 14 17:10:11 user nova-compute[71689]:     <apic/>
Apr 14 17:10:11 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:10:11 user nova-compute[71689]:   </features>
Apr 14 17:10:11 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:10:11 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:10:11 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:10:11 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:10:11 user nova-compute[71689]:   </clock>
Apr 14 17:10:11 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:10:11 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:10:11 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:10:11 user nova-compute[71689]:   </cpu>
Apr 14 17:10:11 user nova-compute[71689]:   <devices>
Apr 14 17:10:11 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:10:11 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:10:11 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk"/>
Apr 14 17:10:11 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:10:11 user nova-compute[71689]:     </disk>
Apr 14 17:10:11 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:10:11 user nova-compute[71689]:       <mac address="fa:16:3e:e2:00:5e"/>
Apr 14 17:10:11 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:10:11 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:10:11 user nova-compute[71689]:       <target dev="tap84d1f2c3-e0"/>
Apr 14 17:10:11 user nova-compute[71689]:     </interface>
Apr 14 17:10:11 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:10:11 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/console.log" append="off"/>
Apr 14 17:10:11 user nova-compute[71689]:     </serial>
Apr 14 17:10:11 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:10:11 user nova-compute[71689]:     <video>
Apr 14 17:10:11 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:10:11 user nova-compute[71689]:     </video>
Apr 14 17:10:11 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:10:11 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:10:11 user nova-compute[71689]:     </rng>
Apr 14 17:10:11 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:10:11 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:10:11 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:10:11 user nova-compute[71689]:     </memballoon>
Apr 14 17:10:11 user nova-compute[71689]:   </devices>
Apr 14 17:10:11 user nova-compute[71689]: </domain>
Apr 14 17:10:11 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-128880765',display_name='tempest-AttachVolumeNegativeTest-server-128880765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-128880765',id=18,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTdefih26p4VWLlEtU9B5X8kXev8KrkLhnDrViyCkzWshAjGw+6zUvio9aNibzsCRg3M8zqQXAtV/jSH9vT630W3rFV6Oo2EOMEB51kmqtYD1qr26uKQ8UwWYLpsALnQ==',key_name='tempest-keypair-2060261619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-mksdki93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=7213d0b2-6eac-449b-aa4b-44088686abac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG os_vif [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d1f2c3-e0, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d1f2c3-e0, col_values=(('external_ids', {'iface-id': '84d1f2c3-e095-4535-92c3-9ff189992179', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:00:5e', 'vm-uuid': '7213d0b2-6eac-449b-aa4b-44088686abac'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:11 user nova-compute[71689]: INFO os_vif [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0')
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:e2:00:5e, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updated VIF entry in instance network info cache for port 84d1f2c3-e095-4535-92c3-9ff189992179. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updating instance_info_cache with network_info: [{"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Releasing lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] No waiting events found dispatching network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:12 user nova-compute[71689]: WARNING nova.compute.manager [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received unexpected event network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 for instance with vm_state building and task_state spawning.
Apr 14 17:10:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492214.6458905, 7213d0b2-6eac-449b-aa4b-44088686abac => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] VM Resumed (Lifecycle Event)
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Instance spawned successfully.
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492214.647327, 7213d0b2-6eac-449b-aa4b-44088686abac => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] VM Started (Lifecycle Event)
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] No waiting events found dispatching network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:14 user nova-compute[71689]: WARNING nova.compute.manager [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received unexpected event network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 for instance with vm_state building and task_state spawning.
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 14 17:10:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:14 user nova-compute[71689]: INFO nova.compute.manager [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Took 6.65 seconds to build instance.
Apr 14 17:10:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.744s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:10:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:23 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:23 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=26.44784164428711GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5920661-9030-4cf7-88a0-1ad789eec1bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7213d0b2-6eac-449b-aa4b-44088686abac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:10:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:24 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:10:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 3ed9bc80-9e7d-4de9-ac86-704c927b111d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updating instance_info_cache with network_info: [{"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-3ed9bc80-9e7d-4de9-ac86-704c927b111d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:10:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing instance network info cache due to event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG nova.network.neutron [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG nova.network.neutron [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updated VIF entry in instance network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG nova.network.neutron [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:31 user nova-compute[71689]: INFO nova.compute.manager [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Shelving
Apr 14 17:10:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-unplugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-unplugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:32 user nova-compute[71689]: WARNING nova.compute.manager [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-unplugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state active and task_state shelving.
Apr 14 17:10:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance destroyed successfully.
Apr 14 17:10:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Beginning cold snapshot process
Apr 14 17:10:32 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk /opt/stack/data/nova/instances/snapshots/tmplcreeycm/86eb966ee44349a9aeb58c7410e68d4b {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk /opt/stack/data/nova/instances/snapshots/tmplcreeycm/86eb966ee44349a9aeb58c7410e68d4b" returned: 0 in 0.386s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Snapshot extracted, beginning image upload
Apr 14 17:10:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:34 user nova-compute[71689]: WARNING nova.compute.manager [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 17:10:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:35 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Snapshot image upload complete
Apr 14 17:10:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:35 user nova-compute[71689]: INFO nova.compute.manager [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Shelve offloading
Apr 14 17:10:35 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance destroyed successfully.
Apr 14 17:10:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:10:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:36 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance destroyed successfully.
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'resources' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-955558461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-955558461',id=17,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJFC8aHWWcd1B2OKM8xgRJWOuubZu8WyhuvxCCUHyDbwuTPBWSPjT8SoG+9FRiu9oyr4dmhioU2TIDdW0FcVGzCucc3oP1Egh2HH6SxTaumSFKNLHUxywdDbLcwsw7FyA==',key_name='tempest-keypair-2086238855',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:08:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-a0vbjsvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member',shelved_at='2023-04-14T17:10:35.363859',shelved_host='user',shelved_image_id='6edf8916-1a2b-42eb-86f0-6a5af9f9405d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=a0fe02ed-b8cd-43ac-9210-d36e8c90de5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG os_vif [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf606ba05-7c, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing instance network info cache due to event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.network.neutron [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:37 user nova-compute[71689]: INFO os_vif [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c')
Apr 14 17:10:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Deleting instance files /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c_del
Apr 14 17:10:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Deletion of /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c_del complete
Apr 14 17:10:37 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Deleted allocations for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'numa_topology' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.network.neutron [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updated VIF entry in instance network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG nova.network.neutron [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf606ba05-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.312s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492232.2398922, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:47 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] VM Stopped (Lifecycle Event)
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17c26b8a-288f-40d0-bb8a-7302312ec9fb None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:10:47 user nova-compute[71689]: INFO nova.compute.claims [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Claim successful on node user
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:10:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.policy [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:10:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Creating image(s)
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:10:48 user nova-compute[71689]: INFO nova.compute.claims [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Claim successful on node user
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.182s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk 1073741824" returned: 0 in 0.067s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Cannot resize image /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'migration_context' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Ensure instance console log exists: /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:10:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:10:48 user nova-compute[71689]: INFO nova.compute.claims [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Claim successful on node user
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.policy [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:10:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Creating image(s)
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.175s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Successfully created port: 1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk 1073741824" returned: 0 in 0.050s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Cannot resize image /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'migration_context' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Ensure instance console log exists: /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:49 user nova-compute[71689]: INFO nova.virt.block_device [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Booting with blank volume at /dev/vda
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.policy [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:10:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Successfully created port: 1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Successfully updated port: 1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-changed-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Refreshing instance network info cache due to event network-changed-1477a3d2-85fc-4f05-83a0-156f88fc4939. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Acquiring lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Successfully created port: cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance network_info: |[{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Acquired lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Refreshing network info cache for port 1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Start _get_guest_xml network_info=[{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:10:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1263709076',display_name='tempest-ServerRescueNegativeTestJSON-server-1263709076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1263709076',id=19,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-aknh1hwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:48Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=a075e35f-c43c-4e3a-adb2-2e1629079d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'pci_devices' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Successfully updated port: 1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-changed-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Refreshing instance network info cache due to event network-changed-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Acquiring lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Acquired lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Refreshing network info cache for port 1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:10:50 user nova-compute[71689]:   <uuid>a075e35f-c43c-4e3a-adb2-2e1629079d93</uuid>
Apr 14 17:10:50 user nova-compute[71689]:   <name>instance-00000013</name>
Apr 14 17:10:50 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:10:50 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:10:50 user nova-compute[71689]:   <metadata>
Apr 14 17:10:50 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:10:50 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:10:50 user nova-compute[71689]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1263709076</nova:name>
Apr 14 17:10:50 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:10:50</nova:creationTime>
Apr 14 17:10:50 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:10:50 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:10:50 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:10:50 user nova-compute[71689]:       <nova:owner>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:user uuid="2434278fe61447fab1f5a930aa16a1de">tempest-ServerRescueNegativeTestJSON-2056337871-project-member</nova:user>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:project uuid="070c6b9f620548b183904d1971f35752">tempest-ServerRescueNegativeTestJSON-2056337871</nova:project>
Apr 14 17:10:50 user nova-compute[71689]:       </nova:owner>
Apr 14 17:10:50 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:10:50 user nova-compute[71689]:       <nova:ports>
Apr 14 17:10:50 user nova-compute[71689]:         <nova:port uuid="1477a3d2-85fc-4f05-83a0-156f88fc4939">
Apr 14 17:10:50 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:10:50 user nova-compute[71689]:         </nova:port>
Apr 14 17:10:50 user nova-compute[71689]:       </nova:ports>
Apr 14 17:10:50 user nova-compute[71689]:     </nova:instance>
Apr 14 17:10:50 user nova-compute[71689]:   </metadata>
Apr 14 17:10:50 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:10:50 user nova-compute[71689]:     <system>
Apr 14 17:10:50 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:10:50 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:10:50 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:10:50 user nova-compute[71689]:       <entry name="serial">a075e35f-c43c-4e3a-adb2-2e1629079d93</entry>
Apr 14 17:10:50 user nova-compute[71689]:       <entry name="uuid">a075e35f-c43c-4e3a-adb2-2e1629079d93</entry>
Apr 14 17:10:50 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:10:50 user nova-compute[71689]:     </system>
Apr 14 17:10:50 user nova-compute[71689]:   </sysinfo>
Apr 14 17:10:50 user nova-compute[71689]:   <os>
Apr 14 17:10:50 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:10:50 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:10:50 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:10:50 user nova-compute[71689]:   </os>
Apr 14 17:10:50 user nova-compute[71689]:   <features>
Apr 14 17:10:50 user nova-compute[71689]:     <acpi/>
Apr 14 17:10:50 user nova-compute[71689]:     <apic/>
Apr 14 17:10:50 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:10:50 user nova-compute[71689]:   </features>
Apr 14 17:10:50 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:10:50 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:10:50 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:10:50 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:10:50 user nova-compute[71689]:   </clock>
Apr 14 17:10:50 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:10:50 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:10:50 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:10:50 user nova-compute[71689]:   </cpu>
Apr 14 17:10:50 user nova-compute[71689]:   <devices>
Apr 14 17:10:50 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:10:50 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:10:50 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk"/>
Apr 14 17:10:50 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:10:50 user nova-compute[71689]:     </disk>
Apr 14 17:10:50 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:10:50 user nova-compute[71689]:       <mac address="fa:16:3e:d0:76:39"/>
Apr 14 17:10:50 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:10:50 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:10:50 user nova-compute[71689]:       <target dev="tap1477a3d2-85"/>
Apr 14 17:10:50 user nova-compute[71689]:     </interface>
Apr 14 17:10:50 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:10:50 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/console.log" append="off"/>
Apr 14 17:10:50 user nova-compute[71689]:     </serial>
Apr 14 17:10:50 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:10:50 user nova-compute[71689]:     <video>
Apr 14 17:10:50 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:10:50 user nova-compute[71689]:     </video>
Apr 14 17:10:50 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:10:50 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:10:50 user nova-compute[71689]:     </rng>
Apr 14 17:10:50 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:10:50 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:10:50 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:10:50 user nova-compute[71689]:     </memballoon>
Apr 14 17:10:50 user nova-compute[71689]:   </devices>
Apr 14 17:10:50 user nova-compute[71689]: </domain>
Apr 14 17:10:50 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1263709076',display_name='tempest-ServerRescueNegativeTestJSON-server-1263709076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1263709076',id=19,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-aknh1hwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:48Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=a075e35f-c43c-4e3a-adb2-2e1629079d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG os_vif [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1477a3d2-85, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1477a3d2-85, col_values=(('external_ids', {'iface-id': '1477a3d2-85fc-4f05-83a0-156f88fc4939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:76:39', 'vm-uuid': 'a075e35f-c43c-4e3a-adb2-2e1629079d93'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:50 user nova-compute[71689]: INFO os_vif [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85')
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:10:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:d0:76:39, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Releasing lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updated VIF entry in instance network info cache for port 1477a3d2-85fc-4f05-83a0-156f88fc4939. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Releasing lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Successfully updated port: cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-changed-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Refreshing instance network info cache due to event network-changed-cc3e7d0d-e167-4a0d-b795-babe496d6f8d. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Acquiring lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance network_info: |[{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Start _get_guest_xml network_info=[{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:10:51 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:51 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1925938594',display_name='tempest-ServerRescueNegativeTestJSON-server-1925938594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1925938594',id=20,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-r06rc0hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:49Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=5c01d750-5923-4b61-9f3a-17cf1142f0a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:10:51 user nova-compute[71689]:   <uuid>5c01d750-5923-4b61-9f3a-17cf1142f0a5</uuid>
Apr 14 17:10:51 user nova-compute[71689]:   <name>instance-00000014</name>
Apr 14 17:10:51 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:10:51 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:10:51 user nova-compute[71689]:   <metadata>
Apr 14 17:10:51 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:10:51 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:10:51 user nova-compute[71689]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1925938594</nova:name>
Apr 14 17:10:51 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:10:51</nova:creationTime>
Apr 14 17:10:51 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:10:51 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:10:51 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:10:51 user nova-compute[71689]:       <nova:owner>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:user uuid="2434278fe61447fab1f5a930aa16a1de">tempest-ServerRescueNegativeTestJSON-2056337871-project-member</nova:user>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:project uuid="070c6b9f620548b183904d1971f35752">tempest-ServerRescueNegativeTestJSON-2056337871</nova:project>
Apr 14 17:10:51 user nova-compute[71689]:       </nova:owner>
Apr 14 17:10:51 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:10:51 user nova-compute[71689]:       <nova:ports>
Apr 14 17:10:51 user nova-compute[71689]:         <nova:port uuid="1d44e719-ffdb-40ff-8b17-bf5d79e1df7e">
Apr 14 17:10:51 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 17:10:51 user nova-compute[71689]:         </nova:port>
Apr 14 17:10:51 user nova-compute[71689]:       </nova:ports>
Apr 14 17:10:51 user nova-compute[71689]:     </nova:instance>
Apr 14 17:10:51 user nova-compute[71689]:   </metadata>
Apr 14 17:10:51 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:10:51 user nova-compute[71689]:     <system>
Apr 14 17:10:51 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:10:51 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:10:51 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:10:51 user nova-compute[71689]:       <entry name="serial">5c01d750-5923-4b61-9f3a-17cf1142f0a5</entry>
Apr 14 17:10:51 user nova-compute[71689]:       <entry name="uuid">5c01d750-5923-4b61-9f3a-17cf1142f0a5</entry>
Apr 14 17:10:51 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:10:51 user nova-compute[71689]:     </system>
Apr 14 17:10:51 user nova-compute[71689]:   </sysinfo>
Apr 14 17:10:51 user nova-compute[71689]:   <os>
Apr 14 17:10:51 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:10:51 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:10:51 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:10:51 user nova-compute[71689]:   </os>
Apr 14 17:10:51 user nova-compute[71689]:   <features>
Apr 14 17:10:51 user nova-compute[71689]:     <acpi/>
Apr 14 17:10:51 user nova-compute[71689]:     <apic/>
Apr 14 17:10:51 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:10:51 user nova-compute[71689]:   </features>
Apr 14 17:10:51 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:10:51 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:10:51 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:10:51 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:10:51 user nova-compute[71689]:   </clock>
Apr 14 17:10:51 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:10:51 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:10:51 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:10:51 user nova-compute[71689]:   </cpu>
Apr 14 17:10:51 user nova-compute[71689]:   <devices>
Apr 14 17:10:51 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:10:51 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:10:51 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk"/>
Apr 14 17:10:51 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:10:51 user nova-compute[71689]:     </disk>
Apr 14 17:10:51 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:10:51 user nova-compute[71689]:       <mac address="fa:16:3e:bf:ad:b2"/>
Apr 14 17:10:51 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:10:51 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:10:51 user nova-compute[71689]:       <target dev="tap1d44e719-ff"/>
Apr 14 17:10:51 user nova-compute[71689]:     </interface>
Apr 14 17:10:51 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:10:51 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/console.log" append="off"/>
Apr 14 17:10:51 user nova-compute[71689]:     </serial>
Apr 14 17:10:51 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:10:51 user nova-compute[71689]:     <video>
Apr 14 17:10:51 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:10:51 user nova-compute[71689]:     </video>
Apr 14 17:10:51 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:10:51 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:10:51 user nova-compute[71689]:     </rng>
Apr 14 17:10:51 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:10:51 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:10:51 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:10:51 user nova-compute[71689]:     </memballoon>
Apr 14 17:10:51 user nova-compute[71689]:   </devices>
Apr 14 17:10:51 user nova-compute[71689]: </domain>
Apr 14 17:10:51 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1925938594',display_name='tempest-ServerRescueNegativeTestJSON-server-1925938594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1925938594',id=20,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-r06rc0hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:49Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=5c01d750-5923-4b61-9f3a-17cf1142f0a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG os_vif [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d44e719-ff, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d44e719-ff, col_values=(('external_ids', {'iface-id': '1d44e719-ffdb-40ff-8b17-bf5d79e1df7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:ad:b2', 'vm-uuid': '5c01d750-5923-4b61-9f3a-17cf1142f0a5'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:51 user nova-compute[71689]: INFO os_vif [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff')
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:bf:ad:b2, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance network_info: |[{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Acquired lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:10:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Refreshing network info cache for port cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:10:52 user nova-compute[71689]: DEBUG nova.network.neutron [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updated VIF entry in instance network info cache for port cc3e7d0d-e167-4a0d-b795-babe496d6f8d. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:10:52 user nova-compute[71689]: DEBUG nova.network.neutron [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:10:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Releasing lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:10:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:53 user nova-compute[71689]: WARNING nova.compute.manager [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state building and task_state spawning.
Apr 14 17:10:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:54 user nova-compute[71689]: WARNING nova.compute.manager [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state building and task_state spawning.
Apr 14 17:10:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG os_brick.utils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6782b5-2e8c-48e9-8a32-1de7b3b0127f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d44f7ae-9077-4ce1-8982-611f8818c843]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baa961-c7b2-467b-b17e-d0c3aa39f5bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4575292-7b3d-4481-a1c9-93229ea3401a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:55 user nova-compute[71689]: WARNING nova.compute.manager [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state building and task_state spawning.
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:10:55 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:10:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b7a5f-cb21-4793-8070-a636d8b10a37]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG os_brick.utils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:10:55 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating existing volume attachment record: 1a29bc9f-142d-4070-ad0a-903af0681b7e {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492256.2084086, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Resumed (Lifecycle Event)
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance spawned successfully.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance spawned successfully.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:10:56 user nova-compute[71689]: WARNING nova.compute.manager [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state building and task_state spawning.
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492256.2099876, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Started (Lifecycle Event)
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492256.2152245, 5c01d750-5923-4b61-9f3a-17cf1142f0a5 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] VM Resumed (Lifecycle Event)
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Took 8.49 seconds to spawn the instance on the hypervisor.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Took 7.42 seconds to spawn the instance on the hypervisor.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492256.2153249, 5c01d750-5923-4b61-9f3a-17cf1142f0a5 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] VM Started (Lifecycle Event)
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Took 9.24 seconds to build instance.
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:10:56 user nova-compute[71689]: INFO nova.compute.manager [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Took 8.37 seconds to build instance.
Apr 14 17:10:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.367s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.518s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:10:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:10:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:11:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Creating image(s)
Apr 14 17:11:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Ensure instance console log exists: /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Start _get_guest_xml network_info=[{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d1a580c-99da-46df-b02d-e2462d8ef26b', 'attached_at': '', 'detached_at': '', 'volume_id': '27d88a38-1e4b-4cfe-9e40-632022a9f510', 'serial': '27d88a38-1e4b-4cfe-9e40-632022a9f510'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1a29bc9f-142d-4070-ad0a-903af0681b7e', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:11:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:11:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:11:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:11:01 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b580fb-c485-46ab-a5cf-b8a414c2dee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:11:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3865f8f-8c03-4bc4-9fca-92e0817ea3e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510] added
Apr 14 17:11:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd85be-9a31-483c-83b4-bbefc6c0eee5]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fbfd4b-343a-48dd-a43d-b8b388a27442]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTZiSeGn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTZiSeGn" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36550259-5ea1-48d1-889f-a1acaf3f6911]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTZiSeGn'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[65844bef-b4b0-4451-a3c6-e2f2823b8946]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[37944c18-6d83-4352-9366-0225e1fdde15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:11:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:11:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:11:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:11:01 user nova-compute[71689]: 
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ef540c-3a93-40a6-864e-72c365731a85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260]
Apr 14 17:11:01 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260] successful.
Apr 14 17:11:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca9777-c05d-40de-b4cf-d8c67501eab8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[51acf2da-cc90-465a-9625-416efde41729]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:11:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:11:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9eaf39-ffb8-4568-9795-6a85dd17e7eb]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:11:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:02 user nova-compute[71689]: INFO nova.compute.manager [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Terminating instance
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23830326339653534', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830326339653534', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-unplugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1024645093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1024645093',id=21,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-dodatc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:50Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=1d1a580c-99da-46df-b02d-e2462d8ef26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:11:02 user nova-compute[71689]:   <uuid>1d1a580c-99da-46df-b02d-e2462d8ef26b</uuid>
Apr 14 17:11:02 user nova-compute[71689]:   <name>instance-00000015</name>
Apr 14 17:11:02 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:11:02 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:11:02 user nova-compute[71689]:   <metadata>
Apr 14 17:11:02 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:11:02 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:11:02 user nova-compute[71689]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1024645093</nova:name>
Apr 14 17:11:02 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:11:01</nova:creationTime>
Apr 14 17:11:02 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:11:02 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:11:02 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:11:02 user nova-compute[71689]:       <nova:owner>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:user uuid="b5c86125160643958349100fb3a7855b">tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member</nova:user>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:project uuid="965bd22f61df40bd89e8ef35fb12bcd3">tempest-ServerBootFromVolumeStableRescueTest-995212803</nova:project>
Apr 14 17:11:02 user nova-compute[71689]:       </nova:owner>
Apr 14 17:11:02 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:11:02 user nova-compute[71689]:       <nova:ports>
Apr 14 17:11:02 user nova-compute[71689]:         <nova:port uuid="cc3e7d0d-e167-4a0d-b795-babe496d6f8d">
Apr 14 17:11:02 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:11:02 user nova-compute[71689]:         </nova:port>
Apr 14 17:11:02 user nova-compute[71689]:       </nova:ports>
Apr 14 17:11:02 user nova-compute[71689]:     </nova:instance>
Apr 14 17:11:02 user nova-compute[71689]:   </metadata>
Apr 14 17:11:02 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:11:02 user nova-compute[71689]:     <system>
Apr 14 17:11:02 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:11:02 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:11:02 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:11:02 user nova-compute[71689]:       <entry name="serial">1d1a580c-99da-46df-b02d-e2462d8ef26b</entry>
Apr 14 17:11:02 user nova-compute[71689]:       <entry name="uuid">1d1a580c-99da-46df-b02d-e2462d8ef26b</entry>
Apr 14 17:11:02 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:11:02 user nova-compute[71689]:     </system>
Apr 14 17:11:02 user nova-compute[71689]:   </sysinfo>
Apr 14 17:11:02 user nova-compute[71689]:   <os>
Apr 14 17:11:02 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:11:02 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:11:02 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:11:02 user nova-compute[71689]:   </os>
Apr 14 17:11:02 user nova-compute[71689]:   <features>
Apr 14 17:11:02 user nova-compute[71689]:     <acpi/>
Apr 14 17:11:02 user nova-compute[71689]:     <apic/>
Apr 14 17:11:02 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:11:02 user nova-compute[71689]:   </features>
Apr 14 17:11:02 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:11:02 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:11:02 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:11:02 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:11:02 user nova-compute[71689]:   </clock>
Apr 14 17:11:02 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:11:02 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:11:02 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:11:02 user nova-compute[71689]:   </cpu>
Apr 14 17:11:02 user nova-compute[71689]:   <devices>
Apr 14 17:11:02 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:11:02 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:11:02 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:11:02 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:11:02 user nova-compute[71689]:       <serial>27d88a38-1e4b-4cfe-9e40-632022a9f510</serial>
Apr 14 17:11:02 user nova-compute[71689]:     </disk>
Apr 14 17:11:02 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:11:02 user nova-compute[71689]:       <mac address="fa:16:3e:7d:6e:78"/>
Apr 14 17:11:02 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:11:02 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:11:02 user nova-compute[71689]:       <target dev="tapcc3e7d0d-e1"/>
Apr 14 17:11:02 user nova-compute[71689]:     </interface>
Apr 14 17:11:02 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:11:02 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/console.log" append="off"/>
Apr 14 17:11:02 user nova-compute[71689]:     </serial>
Apr 14 17:11:02 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:11:02 user nova-compute[71689]:     <video>
Apr 14 17:11:02 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:11:02 user nova-compute[71689]:     </video>
Apr 14 17:11:02 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:11:02 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:11:02 user nova-compute[71689]:     </rng>
Apr 14 17:11:02 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:11:02 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:11:02 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:11:02 user nova-compute[71689]:     </memballoon>
Apr 14 17:11:02 user nova-compute[71689]:   </devices>
Apr 14 17:11:02 user nova-compute[71689]: </domain>
Apr 14 17:11:02 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1024645093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1024645093',id=21,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-dodatc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:50Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=1d1a580c-99da-46df-b02d-e2462d8ef26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG os_vif [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc3e7d0d-e1, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc3e7d0d-e1, col_values=(('external_ids', {'iface-id': 'cc3e7d0d-e167-4a0d-b795-babe496d6f8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:6e:78', 'vm-uuid': '1d1a580c-99da-46df-b02d-e2462d8ef26b'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:02 user nova-compute[71689]: INFO os_vif [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1')
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:11:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No VIF found with MAC fa:16:3e:7d:6e:78, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:11:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Instance destroyed successfully.
Apr 14 17:11:03 user nova-compute[71689]: DEBUG nova.objects.instance [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'resources' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1113450813',display_name='tempest-ServerStableDeviceRescueTest-server-1113450813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1113450813',id=5,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzVLXKTMjj+oWgl5UjeCg470ILAsgtQRYzCsqgruNLBE9s509BMvlpfzsOb9vynIrkGPbYSSRskFS/m1TTup2eransCsvDdeWR+bzlyn30Rn6MOx9JQq0u/nbPnQu7vxQ==',key_name='tempest-keypair-1270943457',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fa2764eee6c4071b5607f78762ca653',ramdisk_id='',reservation_id='r-26b4b70p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-363765322',owner_user_name='tempest-ServerStableDeviceRescueTest-363765322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d67df67ba8e4905bf7c6545c5748a41',uuid=d5920661-9030-4cf7-88a0-1ad789eec1bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converting VIF {"id": "526282d7-c5ce-4ae0-9745-4e43477222f0", "address": "fa:16:3e:c3:f6:95", "network": {"id": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1186556830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fa2764eee6c4071b5607f78762ca653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526282d7-c5", "ovs_interfaceid": "526282d7-c5ce-4ae0-9745-4e43477222f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG os_vif [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap526282d7-c5, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:03 user nova-compute[71689]: INFO os_vif [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f6:95,bridge_name='br-int',has_traffic_filtering=True,id=526282d7-c5ce-4ae0-9745-4e43477222f0,network=Network(37fa35e6-fef6-4271-b78f-d6ab8c37ad0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526282d7-c5')
Apr 14 17:11:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Deleting instance files /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd_del
Apr 14 17:11:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Deletion of /opt/stack/data/nova/instances/d5920661-9030-4cf7-88a0-1ad789eec1bd_del complete
Apr 14 17:11:03 user nova-compute[71689]: INFO nova.compute.manager [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 17:11:03 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:11:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Acquiring lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] No waiting events found dispatching network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:04 user nova-compute[71689]: WARNING nova.compute.manager [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received unexpected event network-vif-plugged-526282d7-c5ce-4ae0-9745-4e43477222f0 for instance with vm_state active and task_state deleting.
Apr 14 17:11:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:11:04 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Took 1.51 seconds to deallocate network for instance.
Apr 14 17:11:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:05 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:11:05 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:11:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:05 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Deleted allocations for instance d5920661-9030-4cf7-88a0-1ad789eec1bd
Apr 14 17:11:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "d5920661-9030-4cf7-88a0-1ad789eec1bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.310s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492266.4420736, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Resumed (Lifecycle Event)
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance spawned successfully.
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492266.4449632, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Started (Lifecycle Event)
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:06 user nova-compute[71689]: WARNING nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state building and task_state spawning.
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Received event network-vif-deleted-526282d7-c5ce-4ae0-9745-4e43477222f0 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:06 user nova-compute[71689]: WARNING nova.compute.manager [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state building and task_state spawning.
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 14 17:11:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:06 user nova-compute[71689]: INFO nova.compute.manager [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Took 17.83 seconds to build instance.
Apr 14 17:11:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.926s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:11 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:11:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:11:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:11:11 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'info_cache' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.neutron [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:11:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance destroyed successfully.
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'resources' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG os_vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed5f4a5-3c, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:11:12 user nova-compute[71689]: INFO os_vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c')
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start _get_guest_xml network_info=[{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'numa_topology' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:12 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'vcpu_model' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'pci_devices' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:11:12 user nova-compute[71689]:   <uuid>d68b702a-a0dc-4030-9893-87b4ef44fb97</uuid>
Apr 14 17:11:12 user nova-compute[71689]:   <name>instance-00000003</name>
Apr 14 17:11:12 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:11:12 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:11:12 user nova-compute[71689]:   <metadata>
Apr 14 17:11:12 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:11:12 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:11:12 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeTestJSON-server-1946928573</nova:name>
Apr 14 17:11:12 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:11:12</nova:creationTime>
Apr 14 17:11:12 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:11:12 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:11:12 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:11:12 user nova-compute[71689]:       <nova:owner>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:user uuid="d7c4734925f645248b0f9060aa78a502">tempest-AttachVolumeTestJSON-917907278-project-member</nova:user>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:project uuid="0c8f6b39515e456c9f5a1affa9f79000">tempest-AttachVolumeTestJSON-917907278</nova:project>
Apr 14 17:11:12 user nova-compute[71689]:       </nova:owner>
Apr 14 17:11:12 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:11:12 user nova-compute[71689]:       <nova:ports>
Apr 14 17:11:12 user nova-compute[71689]:         <nova:port uuid="6ed5f4a5-3c4e-48f6-8667-efda89e23575">
Apr 14 17:11:12 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:11:12 user nova-compute[71689]:         </nova:port>
Apr 14 17:11:12 user nova-compute[71689]:       </nova:ports>
Apr 14 17:11:12 user nova-compute[71689]:     </nova:instance>
Apr 14 17:11:12 user nova-compute[71689]:   </metadata>
Apr 14 17:11:12 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:11:12 user nova-compute[71689]:     <system>
Apr 14 17:11:12 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:11:12 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:11:12 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:11:12 user nova-compute[71689]:       <entry name="serial">d68b702a-a0dc-4030-9893-87b4ef44fb97</entry>
Apr 14 17:11:12 user nova-compute[71689]:       <entry name="uuid">d68b702a-a0dc-4030-9893-87b4ef44fb97</entry>
Apr 14 17:11:12 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:11:12 user nova-compute[71689]:     </system>
Apr 14 17:11:12 user nova-compute[71689]:   </sysinfo>
Apr 14 17:11:12 user nova-compute[71689]:   <os>
Apr 14 17:11:12 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:11:12 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:11:12 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:11:12 user nova-compute[71689]:   </os>
Apr 14 17:11:12 user nova-compute[71689]:   <features>
Apr 14 17:11:12 user nova-compute[71689]:     <acpi/>
Apr 14 17:11:12 user nova-compute[71689]:     <apic/>
Apr 14 17:11:12 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:11:12 user nova-compute[71689]:   </features>
Apr 14 17:11:12 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:11:12 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:11:12 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:11:12 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:11:12 user nova-compute[71689]:   </clock>
Apr 14 17:11:12 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:11:12 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:11:12 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:11:12 user nova-compute[71689]:   </cpu>
Apr 14 17:11:12 user nova-compute[71689]:   <devices>
Apr 14 17:11:12 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:11:12 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:11:12 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk"/>
Apr 14 17:11:12 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:11:12 user nova-compute[71689]:     </disk>
Apr 14 17:11:12 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:11:12 user nova-compute[71689]:       <mac address="fa:16:3e:bf:7d:0c"/>
Apr 14 17:11:12 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:11:12 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:11:12 user nova-compute[71689]:       <target dev="tap6ed5f4a5-3c"/>
Apr 14 17:11:12 user nova-compute[71689]:     </interface>
Apr 14 17:11:12 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:11:12 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/console.log" append="off"/>
Apr 14 17:11:12 user nova-compute[71689]:     </serial>
Apr 14 17:11:12 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:11:12 user nova-compute[71689]:     <video>
Apr 14 17:11:12 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:11:12 user nova-compute[71689]:     </video>
Apr 14 17:11:12 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:11:12 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:11:12 user nova-compute[71689]:     </rng>
Apr 14 17:11:12 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:11:12 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:11:12 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:11:12 user nova-compute[71689]:     </memballoon>
Apr 14 17:11:12 user nova-compute[71689]:   </devices>
Apr 14 17:11:12 user nova-compute[71689]: </domain>
Apr 14 17:11:12 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'trusted_certs' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Cannot resize image /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'migration_context' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG os_vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed5f4a5-3c, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ed5f4a5-3c, col_values=(('external_ids', {'iface-id': '6ed5f4a5-3c4e-48f6-8667-efda89e23575', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:7d:0c', 'vm-uuid': 'd68b702a-a0dc-4030-9893-87b4ef44fb97'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:11:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:12 user nova-compute[71689]: INFO os_vif [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c')
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:14 user nova-compute[71689]: WARNING nova.compute.manager [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state stopped and task_state powering-on.
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492276.4050434, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:16 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Resumed (Lifecycle Event)
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:11:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance rebooted successfully.
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:11:16 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492276.406922, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:16 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Started (Lifecycle Event)
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:16 user nova-compute[71689]: WARNING nova.compute.manager [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state active and task_state None.
Apr 14 17:11:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:18 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492263.109099, d5920661-9030-4cf7-88a0-1ad789eec1bd => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:18 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] VM Stopped (Lifecycle Event)
Apr 14 17:11:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5150df5a-4ad5-47ca-b4a9-ed5a764130cf None None] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:24 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:24 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=26.441104888916016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7213d0b2-6eac-449b-aa4b-44088686abac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:11:24 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:11:25 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:11:25 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:11:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:11:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [{"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d68b702a-a0dc-4030-9893-87b4ef44fb97" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:11:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:11:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:11:46 user nova-compute[71689]: INFO nova.compute.claims [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Claim successful on node user
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:11:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.policy [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:11:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Creating image(s)
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "9a1f320b0d027924251d7e8f1fb2431ad82a6afc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "9a1f320b0d027924251d7e8f1fb2431ad82a6afc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG nova.virt.images [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 2575725f-bb4e-408e-8718-10139aaf6e19 was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.part /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Successfully created port: 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.part /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.converted" returned: 0 in 0.167s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "9a1f320b0d027924251d7e8f1fb2431ad82a6afc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.964s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "9a1f320b0d027924251d7e8f1fb2431ad82a6afc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "9a1f320b0d027924251d7e8f1fb2431ad82a6afc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc,backing_fmt=raw /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc,backing_fmt=raw /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk 1073741824" returned: 0 in 0.047s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "9a1f320b0d027924251d7e8f1fb2431ad82a6afc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Successfully updated port: 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing instance network info cache due to event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Cannot resize image /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'migration_context' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Ensure instance console log exists: /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance network_info: |[{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Start _get_guest_xml network_info=[{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T17:11:43Z,direct_url=<?>,disk_format='qcow2',id=2575725f-bb4e-408e-8718-10139aaf6e19,min_disk=0,min_ram=0,name='tempest-scenario-img--563175815',owner='0a92a4f922f442a88cfb86f8239e52ac',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T17:11:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': '2575725f-bb4e-408e-8718-10139aaf6e19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:11:48 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:48 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T17:11:43Z,direct_url=<?>,disk_format='qcow2',id=2575725f-bb4e-408e-8718-10139aaf6e19,min_disk=0,min_ram=0,name='tempest-scenario-img--563175815',owner='0a92a4f922f442a88cfb86f8239e52ac',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T17:11:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1774561863',display_name='tempest-TestMinimumBasicScenario-server-1774561863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1774561863',id=22,image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg==',key_name='tempest-TestMinimumBasicScenario-117998537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-qq80e7pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:11:47Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=35dee18b-ac00-4f46-813e-7a7b400cdba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'pci_devices' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:11:48 user nova-compute[71689]:   <uuid>35dee18b-ac00-4f46-813e-7a7b400cdba5</uuid>
Apr 14 17:11:48 user nova-compute[71689]:   <name>instance-00000016</name>
Apr 14 17:11:48 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:11:48 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:11:48 user nova-compute[71689]:   <metadata>
Apr 14 17:11:48 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:11:48 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:11:48 user nova-compute[71689]:       <nova:name>tempest-TestMinimumBasicScenario-server-1774561863</nova:name>
Apr 14 17:11:48 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:11:48</nova:creationTime>
Apr 14 17:11:48 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:11:48 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:11:48 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:11:48 user nova-compute[71689]:       <nova:owner>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:user uuid="4bd0842f11b0499298e2af46ad659962">tempest-TestMinimumBasicScenario-1645387059-project-member</nova:user>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:project uuid="0a92a4f922f442a88cfb86f8239e52ac">tempest-TestMinimumBasicScenario-1645387059</nova:project>
Apr 14 17:11:48 user nova-compute[71689]:       </nova:owner>
Apr 14 17:11:48 user nova-compute[71689]:       <nova:root type="image" uuid="2575725f-bb4e-408e-8718-10139aaf6e19"/>
Apr 14 17:11:48 user nova-compute[71689]:       <nova:ports>
Apr 14 17:11:48 user nova-compute[71689]:         <nova:port uuid="4295b114-8b6f-42e4-97c3-d6f972188a25">
Apr 14 17:11:48 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 17:11:48 user nova-compute[71689]:         </nova:port>
Apr 14 17:11:48 user nova-compute[71689]:       </nova:ports>
Apr 14 17:11:48 user nova-compute[71689]:     </nova:instance>
Apr 14 17:11:48 user nova-compute[71689]:   </metadata>
Apr 14 17:11:48 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:11:48 user nova-compute[71689]:     <system>
Apr 14 17:11:48 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:11:48 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:11:48 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:11:48 user nova-compute[71689]:       <entry name="serial">35dee18b-ac00-4f46-813e-7a7b400cdba5</entry>
Apr 14 17:11:48 user nova-compute[71689]:       <entry name="uuid">35dee18b-ac00-4f46-813e-7a7b400cdba5</entry>
Apr 14 17:11:48 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:11:48 user nova-compute[71689]:     </system>
Apr 14 17:11:48 user nova-compute[71689]:   </sysinfo>
Apr 14 17:11:48 user nova-compute[71689]:   <os>
Apr 14 17:11:48 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:11:48 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:11:48 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:11:48 user nova-compute[71689]:   </os>
Apr 14 17:11:48 user nova-compute[71689]:   <features>
Apr 14 17:11:48 user nova-compute[71689]:     <acpi/>
Apr 14 17:11:48 user nova-compute[71689]:     <apic/>
Apr 14 17:11:48 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:11:48 user nova-compute[71689]:   </features>
Apr 14 17:11:48 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:11:48 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:11:48 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:11:48 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:11:48 user nova-compute[71689]:   </clock>
Apr 14 17:11:48 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:11:48 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:11:48 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:11:48 user nova-compute[71689]:   </cpu>
Apr 14 17:11:48 user nova-compute[71689]:   <devices>
Apr 14 17:11:48 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:11:48 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:11:48 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk"/>
Apr 14 17:11:48 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:11:48 user nova-compute[71689]:     </disk>
Apr 14 17:11:48 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:11:48 user nova-compute[71689]:       <mac address="fa:16:3e:e3:7a:9b"/>
Apr 14 17:11:48 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:11:48 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:11:48 user nova-compute[71689]:       <target dev="tap4295b114-8b"/>
Apr 14 17:11:48 user nova-compute[71689]:     </interface>
Apr 14 17:11:48 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:11:48 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/console.log" append="off"/>
Apr 14 17:11:48 user nova-compute[71689]:     </serial>
Apr 14 17:11:48 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:11:48 user nova-compute[71689]:     <video>
Apr 14 17:11:48 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:11:48 user nova-compute[71689]:     </video>
Apr 14 17:11:48 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:11:48 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:11:48 user nova-compute[71689]:     </rng>
Apr 14 17:11:48 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:11:48 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:11:48 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:11:48 user nova-compute[71689]:     </memballoon>
Apr 14 17:11:48 user nova-compute[71689]:   </devices>
Apr 14 17:11:48 user nova-compute[71689]: </domain>
Apr 14 17:11:48 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1774561863',display_name='tempest-TestMinimumBasicScenario-server-1774561863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1774561863',id=22,image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg==',key_name='tempest-TestMinimumBasicScenario-117998537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-qq80e7pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:11:47Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=35dee18b-ac00-4f46-813e-7a7b400cdba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG os_vif [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4295b114-8b, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4295b114-8b, col_values=(('external_ids', {'iface-id': '4295b114-8b6f-42e4-97c3-d6f972188a25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:7a:9b', 'vm-uuid': '35dee18b-ac00-4f46-813e-7a7b400cdba5'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:48 user nova-compute[71689]: INFO os_vif [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b')
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No VIF found with MAC fa:16:3e:e3:7a:9b, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updated VIF entry in instance network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:11:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:11:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:50 user nova-compute[71689]: WARNING nova.compute.manager [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state building and task_state spawning.
Apr 14 17:11:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492312.13837, 35dee18b-ac00-4f46-813e-7a7b400cdba5 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] VM Resumed (Lifecycle Event)
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance spawned successfully.
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492312.1421323, 35dee18b-ac00-4f46-813e-7a7b400cdba5 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] VM Started (Lifecycle Event)
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:11:52 user nova-compute[71689]: WARNING nova.compute.manager [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state building and task_state spawning.
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Took 5.72 seconds to spawn the instance on the hypervisor.
Apr 14 17:11:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:11:52 user nova-compute[71689]: INFO nova.compute.manager [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Took 6.36 seconds to build instance.
Apr 14 17:11:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.484s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:11:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-changed-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Refreshing instance network info cache due to event network-changed-84d1f2c3-e095-4535-92c3-9ff189992179. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Acquiring lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Acquired lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Refreshing network info cache for port 84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updated VIF entry in instance network info cache for port 84d1f2c3-e095-4535-92c3-9ff189992179. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updating instance_info_cache with network_info: [{"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:11:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Releasing lock "refresh_cache-7213d0b2-6eac-449b-aa4b-44088686abac" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'flavor' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:01 user nova-compute[71689]: INFO nova.compute.manager [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attaching volume 64feafc1-f567-4496-bde0-d3fa057a7728 to /dev/vdb
Apr 14 17:12:01 user nova-compute[71689]: DEBUG os_brick.utils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4753a10a-90f9-4e1d-8f08-028109f2b682]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704a132-4de9-4c63-886d-8590e50bedb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1324fd97-5fa5-4b11-b6d3-2d48e51805f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3466730d-55c9-4c90-a005-401c382e2d42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:01 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:12:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda39419-879c-4aaf-b979-57e3e604b3f4]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG os_brick.utils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:01 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating existing volume attachment record: d589cd24-9688-4cd3-81a1-6a45495a12c6 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:02 user nova-compute[71689]: INFO nova.compute.manager [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Attaching volume d8612253-7088-46ce-82ea-01673c071861 to /dev/vdb
Apr 14 17:12:02 user nova-compute[71689]: DEBUG os_brick.utils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[799cb2f9-2f14-4c9b-8ba7-499780a0e342]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69917c1-29af-43e2-8dbd-461df37320ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998739a-29b1-4044-a938-676862f4a055]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d32ef4-b678-4224-abeb-a3104b618846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:02 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:12:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c2e96-7b67-429e-b7f7-01ed2406693f]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG os_brick.utils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:02 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updating existing volume attachment record: 2ab977c8-0879-4955-9bc5-fb0b7066934a {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:12:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVMqpRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:07 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:07 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:07 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[423250fd-88fe-4e9c-ac29-829aa85d27f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:12:07 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[12166362-9413-4bed-9141-f264e2bbbb9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861] added
Apr 14 17:12:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0756c08a-0aca-4c2b-b4f1-10c2f8a42beb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef9d9fb-2416-4fe2-88ff-3051f75c88bb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBVMqpRD {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBVMqpRD" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbd5ae0-c706-4a91-84e9-e61db7abe306]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBVMqpRD'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ab5002-6471-4db6-a9b0-707146fe6f76]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8dd2f-3b17-4f34-bb11-355e34891e2b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6b461c-a918-43c0-bf04-8fb3f7af4c1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260]
Apr 14 17:12:07 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260] successful.
Apr 14 17:12:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c6e70-90e5-49b3-ac5d-074a5a623053]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4cafe-9f1a-41ce-8de1-daf4ba2f5cf4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:07 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:07 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805c259-a7c1-44d3-89e6-b60aeb6e6bf5]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:12:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVMqpRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23234663739356232', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234663739356232', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:12:08 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:08 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:12:08 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:12:08 user nova-compute[71689]:   <serial>d8612253-7088-46ce-82ea-01673c071861</serial>
Apr 14 17:12:08 user nova-compute[71689]: </disk>
Apr 14 17:12:08 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:08 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:08 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:08 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b908e6-262a-453b-ba0c-b189b7a7ff86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:12:08 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7dc39-863e-4eca-959b-c6b5e5c4e9e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728] added
Apr 14 17:12:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe0947-7d76-48dc-a914-216d27349237]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.118s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe26b7d-7c8c-45ef-bfe4-da3e81ac994e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQsJhLry {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQsJhLry" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ef7e4-5caa-41fe-be2d-8f63c062d71b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQsJhLry'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8459004-dbda-4c59-a4e9-eb447e869abd]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dba2dd-6f18-4759-aa9e-76a7480f5f07]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[736996c1-6acc-4d81-93bc-54994f46768a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]
Apr 14 17:12:08 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.
Apr 14 17:12:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c114e9ee-deb7-48bc-a467-690431e48556]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[31182fc8-32e8-49da-96bd-424c5aecc47b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:e2:00:5e, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[033038c1-e949-472f-960e-a2c688b06cb2]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:12:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.767s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26435326231303433', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435326231303433', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG nova.objects.instance [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'flavor' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:12:09 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:09 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:12:09 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:12:09 user nova-compute[71689]:   <serial>64feafc1-f567-4496-bde0-d3fa057a7728</serial>
Apr 14 17:12:09 user nova-compute[71689]: </disk>
Apr 14 17:12:09 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:10 user nova-compute[71689]: INFO nova.compute.manager [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Detaching volume d8612253-7088-46ce-82ea-01673c071861
Apr 14 17:12:10 user nova-compute[71689]: INFO nova.virt.block_device [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Attempting to driver detach volume d8612253-7088-46ce-82ea-01673c071861 from mountpoint /dev/vdb
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Attempting to detach device vdb from instance 7213d0b2-6eac-449b-aa4b-44088686abac from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:12:10 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:10 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:12:10 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:12:10 user nova-compute[71689]:   <serial>d8612253-7088-46ce-82ea-01673c071861</serial>
Apr 14 17:12:10 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:12:10 user nova-compute[71689]: </disk>
Apr 14 17:12:10 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:12:10 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully detached device vdb from instance 7213d0b2-6eac-449b-aa4b-44088686abac from the persistent domain config.
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7213d0b2-6eac-449b-aa4b-44088686abac from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:12:10 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:10 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:12:10 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:12:10 user nova-compute[71689]:   <serial>d8612253-7088-46ce-82ea-01673c071861</serial>
Apr 14 17:12:10 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:12:10 user nova-compute[71689]: </disk>
Apr 14 17:12:10 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:0a:01:98, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.285s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492330.7413752, 7213d0b2-6eac-449b-aa4b-44088686abac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:12:10 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully detached device vdb from instance 7213d0b2-6eac-449b-aa4b-44088686abac from the live domain config.
Apr 14 17:12:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVMqpRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:10 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b3862-7890-4ea7-8376-26c9cf454822]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:12:10 user nova-compute[71689]: No targets found.
Apr 14 17:12:10 user nova-compute[71689]: iSNS:
Apr 14 17:12:10 user nova-compute[71689]: No targets found.
Apr 14 17:12:10 user nova-compute[71689]: STATIC:
Apr 14 17:12:10 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861
Apr 14 17:12:10 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:12:10 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:12:10 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:12:10 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:12:10 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:12:10 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:12:10 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:12:10 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:12:10 user nova-compute[71689]: FIRMWARE:
Apr 14 17:12:10 user nova-compute[71689]: No targets found.
Apr 14 17:12:10 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:12:10 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:12:10 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414b8aa-0de4-442e-b7fc-6161dbfba362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[296db7c6-ce26-4523-9306-b34585c6bc27]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:10 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:10 user nova-compute[71689]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:10 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:10 user nova-compute[71689]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 (non-flash)
Apr 14 17:12:10 user nova-compute[71689]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:10 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c216560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd415459-0a6a-4be9-aa0b-b593715fd726]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c531c7-d0df-4497-af61-88ffe37c4941]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd17e23-90cf-44f5-8210-9ecdca62f6b0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20c085-58a1-4c8a-8336-184357508145]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad65434-f8c9-41ea-90ae-556c0b8f0071]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[296b6cf6-1fd0-4226-a769-afe4a7acb5f1]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260]
Apr 14 17:12:11 user nova-compute[71689]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861, portal: 172.16.0.220,3260] successful.
Apr 14 17:12:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612253-7088-46ce-82ea-01673c071861 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441d091-98ee-425b-8d9a-115a79df854b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== disconnect_volume: return (303ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:12:12 user nova-compute[71689]: INFO nova.compute.manager [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Rebuilding instance
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_requests' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_devices' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'migration_context' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71689) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:12 user nova-compute[71689]: WARNING nova.compute.manager [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state rebuilding.
Apr 14 17:12:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance destroyed successfully.
Apr 14 17:12:13 user nova-compute[71689]: INFO nova.compute.manager [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Detaching volume 64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:12:13 user nova-compute[71689]: INFO nova.virt.block_device [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attempting to driver detach volume 64feafc1-f567-4496-bde0-d3fa057a7728 from mountpoint /dev/vdb
Apr 14 17:12:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Attempting to detach device vdb from instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:12:13 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:13 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:12:13 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:12:13 user nova-compute[71689]:   <serial>64feafc1-f567-4496-bde0-d3fa057a7728</serial>
Apr 14 17:12:13 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:12:13 user nova-compute[71689]: </disk>
Apr 14 17:12:13 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:12:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully detached device vdb from instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 from the persistent domain config.
Apr 14 17:12:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:13 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3012a1-d684-464a-b1ff-9d18068f002c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:12:13 user nova-compute[71689]: No targets found.
Apr 14 17:12:13 user nova-compute[71689]: iSNS:
Apr 14 17:12:13 user nova-compute[71689]: No targets found.
Apr 14 17:12:13 user nova-compute[71689]: STATIC:
Apr 14 17:12:13 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:12:13 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:12:13 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:12:13 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:12:13 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:12:13 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:12:13 user nova-compute[71689]: FIRMWARE:
Apr 14 17:12:13 user nova-compute[71689]: No targets found.
Apr 14 17:12:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:12:13 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:12:13 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[73785486-3bca-4fe2-962b-c5e74e2d25ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae653af3-70c8-4aac-9cf0-43f1372fafce]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:13 user nova-compute[71689]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:13 user nova-compute[71689]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c356710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaad7c4f-d60e-4cec-aab2-674d6d90cd27]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a8487-e45a-4849-a3ca-a308e71a002d]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2036147-befa-4aaa-a120-6903095a0edf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f5d9f-c56f-42a1-b834-197f07f54d0e]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff03ac-787a-4101-b3f4-672b3fdfc35d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[650fb133-bb47-4557-9b0a-f2201205d0a5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]
Apr 14 17:12:13 user nova-compute[71689]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.
Apr 14 17:12:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e4d9d-a17d-4c13-ba18-a31a7c6fc759]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (347ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.objects.instance [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.403s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance destroyed successfully.
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:14 user nova-compute[71689]: WARNING nova.compute.manager [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state rebuilding.
Apr 14 17:12:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde268504-35, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:12:14 user nova-compute[71689]: INFO os_vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:14 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada0ad31-17e2-4755-afe3-ca36687d2cda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:12:14 user nova-compute[71689]: No targets found.
Apr 14 17:12:14 user nova-compute[71689]: iSNS:
Apr 14 17:12:14 user nova-compute[71689]: No targets found.
Apr 14 17:12:14 user nova-compute[71689]: STATIC:
Apr 14 17:12:14 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:12:14 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:12:14 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:12:14 user nova-compute[71689]: FIRMWARE:
Apr 14 17:12:14 user nova-compute[71689]: No targets found.
Apr 14 17:12:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:12:14 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:12:14 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[877fb058-bc8b-40b4-8e4b-0fd06ef5015b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9257c0-4498-4247-8199-3df0800a1e5b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b5945dea0>, {}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (81ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:12:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Deleting instance files /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_del
Apr 14 17:12:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Deletion of /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_del complete
Apr 14 17:12:14 user nova-compute[71689]: INFO nova.virt.block_device [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Booting with volume 64feafc1-f567-4496-bde0-d3fa057a7728 at /dev/vdb
Apr 14 17:12:15 user nova-compute[71689]: DEBUG os_brick.utils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb9e37c-cd9d-4ed2-b14f-9d8e3542fc65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a24c4-fddb-4b8d-9e1e-0c92a8d3dde8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a277e955-f66a-4a2b-80da-63e86045fba0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0dbfa9-8cf3-482e-a68e-97a468e8db80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:15 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:12:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf82a95d-9df0-4a12-bfe7-7950d40c417d]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG os_brick.utils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:15 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating existing volume attachment record: 6375211b-526e-4c13-adc8-4a7864276b7a {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:17 user nova-compute[71689]: INFO nova.compute.manager [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Terminating instance
Apr 14 17:12:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-unplugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-unplugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-unplugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Instance destroyed successfully.
Apr 14 17:12:18 user nova-compute[71689]: DEBUG nova.objects.instance [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lazy-loading 'resources' on Instance uuid 3ed9bc80-9e7d-4de9-ac86-704c927b111d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-279445092',display_name='tempest-ServersNegativeTestJSON-server-279445092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-279445092',id=1,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='426156fb00db428683851cf731b680d1',ramdisk_id='',reservation_id='r-ozwlf74f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1832599821',owner_user_name='tempest-ServersNegativeTestJSON-1832599821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:03:49Z,user_data=None,user_id='0d1ea0218b044c1e94f61a07c1d14a75',uuid=3ed9bc80-9e7d-4de9-ac86-704c927b111d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converting VIF {"id": "0b4fc330-8a13-4916-b3be-16398b46bec1", "address": "fa:16:3e:da:93:bd", "network": {"id": "bba4f725-673c-4e1a-a5bb-a435afc40332", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-844369249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426156fb00db428683851cf731b680d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4fc330-8a", "ovs_interfaceid": "0b4fc330-8a13-4916-b3be-16398b46bec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG os_vif [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b4fc330-8a, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:12:18 user nova-compute[71689]: INFO os_vif [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=0b4fc330-8a13-4916-b3be-16398b46bec1,network=Network(bba4f725-673c-4e1a-a5bb-a435afc40332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4fc330-8a')
Apr 14 17:12:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Deleting instance files /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d_del
Apr 14 17:12:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Deletion of /opt/stack/data/nova/instances/3ed9bc80-9e7d-4de9-ac86-704c927b111d_del complete
Apr 14 17:12:18 user nova-compute[71689]: INFO nova.compute.manager [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 14 17:12:18 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:12:19 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Took 0.91 seconds to deallocate network for instance.
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:19 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Deleted allocations for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.442s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:19 user nova-compute[71689]: WARNING nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received unexpected event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with vm_state deleted and task_state None.
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:19 user nova-compute[71689]: WARNING nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received unexpected event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with vm_state deleted and task_state None.
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:19 user nova-compute[71689]: WARNING nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received unexpected event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with vm_state deleted and task_state None.
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Acquiring lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "3ed9bc80-9e7d-4de9-ac86-704c927b111d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] No waiting events found dispatching network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:19 user nova-compute[71689]: WARNING nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received unexpected event network-vif-plugged-0b4fc330-8a13-4916-b3be-16398b46bec1 for instance with vm_state deleted and task_state None.
Apr 14 17:12:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Received event network-vif-deleted-0b4fc330-8a13-4916-b3be-16398b46bec1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:12:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Creating image(s)
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk 1073741824" returned: 0 in 0.057s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Cannot resize image /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Ensure instance console log exists: /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start _get_guest_xml network_info=[{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84c02556-abf7-4832-a1b2-a2c28a7f8e52', 'attached_at': '', 'detached_at': '', 'volume_id': '64feafc1-f567-4496-bde0-d3fa057a7728', 'serial': '64feafc1-f567-4496-bde0-d3fa057a7728'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '6375211b-526e-4c13-adc8-4a7864276b7a', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:12:20 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 17:12:20 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:20 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:20 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:20 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f42ab-51b0-4325-97f2-ddb6d47804fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:12:20 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298b920-0b80-46bd-a4cf-e765e2620100]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728] added
Apr 14 17:12:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2dc2a9-4d52-49b9-976a-08d3784b46bf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef89ae-58af-4560-96f8-df0b9264421b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQsJhLry {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQsJhLry" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdca12a-f256-43b5-b039-30b30c2eeaa1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQsJhLry'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a7da8e-4c15-4a9b-9862-7c47ccabdb2e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff30f707-747b-4674-b1ba-99c6f4000672]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec3f01e-f727-4054-a782-6fc45ea42efe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]
Apr 14 17:12:21 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.
Apr 14 17:12:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4c97f-08db-413a-81a2-cfeef038dcc2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14cab04-b73b-46ad-bf96-3bd70ac6c853]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:21 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:21 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abadd7a-aa80-4487-934c-44b07783025b]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26435326231303433', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435326231303433', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:12:22 user nova-compute[71689]:   <uuid>84c02556-abf7-4832-a1b2-a2c28a7f8e52</uuid>
Apr 14 17:12:22 user nova-compute[71689]:   <name>instance-00000010</name>
Apr 14 17:12:22 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:12:22 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:12:22 user nova-compute[71689]:   <metadata>
Apr 14 17:12:22 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:12:22 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:12:22 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-595094216</nova:name>
Apr 14 17:12:22 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:12:20</nova:creationTime>
Apr 14 17:12:22 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:12:22 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:12:22 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:12:22 user nova-compute[71689]:       <nova:owner>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:12:22 user nova-compute[71689]:       </nova:owner>
Apr 14 17:12:22 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:12:22 user nova-compute[71689]:       <nova:ports>
Apr 14 17:12:22 user nova-compute[71689]:         <nova:port uuid="de268504-352a-4d08-8113-a2098b794478">
Apr 14 17:12:22 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:12:22 user nova-compute[71689]:         </nova:port>
Apr 14 17:12:22 user nova-compute[71689]:       </nova:ports>
Apr 14 17:12:22 user nova-compute[71689]:     </nova:instance>
Apr 14 17:12:22 user nova-compute[71689]:   </metadata>
Apr 14 17:12:22 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:12:22 user nova-compute[71689]:     <system>
Apr 14 17:12:22 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:12:22 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:12:22 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:12:22 user nova-compute[71689]:       <entry name="serial">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:12:22 user nova-compute[71689]:       <entry name="uuid">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:12:22 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:12:22 user nova-compute[71689]:     </system>
Apr 14 17:12:22 user nova-compute[71689]:   </sysinfo>
Apr 14 17:12:22 user nova-compute[71689]:   <os>
Apr 14 17:12:22 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:12:22 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:12:22 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:12:22 user nova-compute[71689]:   </os>
Apr 14 17:12:22 user nova-compute[71689]:   <features>
Apr 14 17:12:22 user nova-compute[71689]:     <acpi/>
Apr 14 17:12:22 user nova-compute[71689]:     <apic/>
Apr 14 17:12:22 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:12:22 user nova-compute[71689]:   </features>
Apr 14 17:12:22 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:12:22 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:12:22 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:12:22 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:12:22 user nova-compute[71689]:   </clock>
Apr 14 17:12:22 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:12:22 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:12:22 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:12:22 user nova-compute[71689]:   </cpu>
Apr 14 17:12:22 user nova-compute[71689]:   <devices>
Apr 14 17:12:22 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:12:22 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:12:22 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk"/>
Apr 14 17:12:22 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:12:22 user nova-compute[71689]:     </disk>
Apr 14 17:12:22 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:12:22 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:22 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:12:22 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:12:22 user nova-compute[71689]:       <serial>64feafc1-f567-4496-bde0-d3fa057a7728</serial>
Apr 14 17:12:22 user nova-compute[71689]:     </disk>
Apr 14 17:12:22 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:12:22 user nova-compute[71689]:       <mac address="fa:16:3e:0a:01:98"/>
Apr 14 17:12:22 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:22 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:12:22 user nova-compute[71689]:       <target dev="tapde268504-35"/>
Apr 14 17:12:22 user nova-compute[71689]:     </interface>
Apr 14 17:12:22 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:12:22 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log" append="off"/>
Apr 14 17:12:22 user nova-compute[71689]:     </serial>
Apr 14 17:12:22 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:12:22 user nova-compute[71689]:     <video>
Apr 14 17:12:22 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:22 user nova-compute[71689]:     </video>
Apr 14 17:12:22 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:12:22 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:12:22 user nova-compute[71689]:     </rng>
Apr 14 17:12:22 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:12:22 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:12:22 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:12:22 user nova-compute[71689]:     </memballoon>
Apr 14 17:12:22 user nova-compute[71689]:   </devices>
Apr 14 17:12:22 user nova-compute[71689]: </domain>
Apr 14 17:12:22 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG os_vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde268504-35, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde268504-35, col_values=(('external_ids', {'iface-id': 'de268504-352a-4d08-8113-a2098b794478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:01:98', 'vm-uuid': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:22 user nova-compute[71689]: INFO os_vif [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:0a:01:98, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:23 user nova-compute[71689]: WARNING nova.compute.manager [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:24 user nova-compute[71689]: INFO nova.compute.manager [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Unshelving
Apr 14 17:12:24 user nova-compute[71689]: INFO nova.virt.block_device [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Booting with volume 37d0e1b4-870e-494c-bc85-ee2c56c4c81f at /dev/vdc
Apr 14 17:12:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG os_brick.utils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[10766235-c3c6-4c5c-b766-72827a4118d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff63c956-0e4d-41f4-929a-7b190dcf2dae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c02935-a44c-4e95-9995-db2a489fcf45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[82511785-21ae-43fc-b0b8-c055fbf3717a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:12:24 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:12:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71b4b16-9914-4dd0-b9dd-c361b6773273]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG os_brick.utils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating existing volume attachment record: 89fc6e8d-41bd-452c-bfce-3a41909e69c8 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:12:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 84c02556-abf7-4832-a1b2-a2c28a7f8e52 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492345.851331, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Resumed (Lifecycle Event)
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:12:25 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance spawned successfully.
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:12:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492345.8608532, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Started (Lifecycle Event)
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:25 user nova-compute[71689]: WARNING nova.compute.manager [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:26 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 17:12:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG nova.objects.instance [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71689) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:28 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:28 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7906MB free_disk=26.4002685546875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7213d0b2-6eac-449b-aa4b-44088686abac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:12:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'pci_requests' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'numa_topology' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:12:29 user nova-compute[71689]: INFO nova.compute.claims [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Claim successful on node user
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:29 user nova-compute[71689]: INFO nova.network.neutron [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating port f606ba05-7c5e-4e88-94ed-a44a82cb8150 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing instance network info cache due to event network-changed-f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updating instance_info_cache with network_info: [{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:12:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Creating image(s)
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG nova.objects.instance [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG nova.network.neutron [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Refreshing network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "5380f362395fb6fa9919162d4c71ffe083b1f0c6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "5380f362395fb6fa9919162d4c71ffe083b1f0c6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG nova.virt.images [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 6edf8916-1a2b-42eb-86f0-6a5af9f9405d was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.part /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.part /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.converted" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updated VIF entry in instance network info cache for port f606ba05-7c5e-4e88-94ed-a44a82cb8150. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "5380f362395fb6fa9919162d4c71ffe083b1f0c6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "5380f362395fb6fa9919162d4c71ffe083b1f0c6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "5380f362395fb6fa9919162d4c71ffe083b1f0c6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6,backing_fmt=raw /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6,backing_fmt=raw /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk 1073741824" returned: 0 in 0.047s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "5380f362395fb6fa9919162d4c71ffe083b1f0c6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG nova.objects.instance [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'migration_context' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Rebasing disk image.
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 -F raw /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:33 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492337.997462, 3ed9bc80-9e7d-4de9-ac86-704c927b111d => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:33 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] VM Stopped (Lifecycle Event)
Apr 14 17:12:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-51ba094c-9e7b-4b78-a626-97b1afe40d04 None None] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 -F raw /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk" returned: 0 in 1.837s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Ensure instance console log exists: /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Start _get_guest_xml network_info=[{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='9e65440fee96c9fe414eaa53ca70cc1a',container_format='bare',created_at=2023-04-14T17:10:32Z,direct_url=<?>,disk_format='qcow2',id=6edf8916-1a2b-42eb-86f0-6a5af9f9405d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-955558461-shelved',owner='1ae1b41823a64cd0b1c1a1669ad202ec',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T17:10:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTdjlVrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a0fe02ed-b8cd-43ac-9210-d36e8c90de5c', 'attached_at': '', 'detached_at': '', 'volume_id': '37d0e1b4-870e-494c-bc85-ee2c56c4c81f', 'serial': '37d0e1b4-870e-494c-bc85-ee2c56c4c81f'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '89fc6e8d-41bd-452c-bfce-3a41909e69c8', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:12:34 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:34 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9e65440fee96c9fe414eaa53ca70cc1a',container_format='bare',created_at=2023-04-14T17:10:32Z,direct_url=<?>,disk_format='qcow2',id=6edf8916-1a2b-42eb-86f0-6a5af9f9405d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-955558461-shelved',owner='1ae1b41823a64cd0b1c1a1669ad202ec',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T17:10:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTdjlVrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:34 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:34 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:34 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:12:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2b226c-717a-4641-8541-179fc1284c1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:12:34 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[81183bc2-c22b-4eba-9609-c0f8dbf0c16d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f] added
Apr 14 17:12:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdfeee0-7e59-4850-a6ac-07d8cfaea77d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[91381530-3ec9-4037-b618-53fcd14a2507]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XTdjlVrg {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XTdjlVrg" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ab48b-a9da-4d1f-924e-6e6e8fb01a13]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XTdjlVrg'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[80075752-3faa-4168-ac3c-cd939d86dc33]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[44de2d9a-008a-4906-9455-7ddf4aedf685]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:34 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:34 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5645093-3f83-4d20-9e91-ce7b7e6d1e44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260]
Apr 14 17:12:34 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260] successful.
Apr 14 17:12:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb27109-a1ae-42c2-9b86-8ff3f2111e2e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f3a90-9b6a-4a2c-94b7-bbed8bc64e49]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:35 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:35 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:12:35 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:35 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:35 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:12:35 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b0882d-85e0-4f67-8840-b20508f7dc6b]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:12:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTdjlVrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26461636430303732', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461636430303732', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-955558461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-955558461',id=17,image_ref='6edf8916-1a2b-42eb-86f0-6a5af9f9405d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2086238855',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:08:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-a0vbjsvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member',shelved_at='2023-04-14T17:10:35.363859',shelved_host='user',shelved_image_id='6edf8916-1a2b-42eb-86f0-6a5af9f9405d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=a0fe02ed-b8cd-43ac-9210-d36e8c90de5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.objects.instance [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'pci_devices' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:12:36 user nova-compute[71689]:   <uuid>a0fe02ed-b8cd-43ac-9210-d36e8c90de5c</uuid>
Apr 14 17:12:36 user nova-compute[71689]:   <name>instance-00000011</name>
Apr 14 17:12:36 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:12:36 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:12:36 user nova-compute[71689]:   <metadata>
Apr 14 17:12:36 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:12:36 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:12:36 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-955558461</nova:name>
Apr 14 17:12:36 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:12:34</nova:creationTime>
Apr 14 17:12:36 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:12:36 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:12:36 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:12:36 user nova-compute[71689]:       <nova:owner>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:user uuid="6aa926d6cfc94b08a564404f95da5483">tempest-AttachVolumeShelveTestJSON-339689049-project-member</nova:user>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:project uuid="1ae1b41823a64cd0b1c1a1669ad202ec">tempest-AttachVolumeShelveTestJSON-339689049</nova:project>
Apr 14 17:12:36 user nova-compute[71689]:       </nova:owner>
Apr 14 17:12:36 user nova-compute[71689]:       <nova:root type="image" uuid="6edf8916-1a2b-42eb-86f0-6a5af9f9405d"/>
Apr 14 17:12:36 user nova-compute[71689]:       <nova:ports>
Apr 14 17:12:36 user nova-compute[71689]:         <nova:port uuid="f606ba05-7c5e-4e88-94ed-a44a82cb8150">
Apr 14 17:12:36 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:12:36 user nova-compute[71689]:         </nova:port>
Apr 14 17:12:36 user nova-compute[71689]:       </nova:ports>
Apr 14 17:12:36 user nova-compute[71689]:     </nova:instance>
Apr 14 17:12:36 user nova-compute[71689]:   </metadata>
Apr 14 17:12:36 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:12:36 user nova-compute[71689]:     <system>
Apr 14 17:12:36 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:12:36 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:12:36 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:12:36 user nova-compute[71689]:       <entry name="serial">a0fe02ed-b8cd-43ac-9210-d36e8c90de5c</entry>
Apr 14 17:12:36 user nova-compute[71689]:       <entry name="uuid">a0fe02ed-b8cd-43ac-9210-d36e8c90de5c</entry>
Apr 14 17:12:36 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:12:36 user nova-compute[71689]:     </system>
Apr 14 17:12:36 user nova-compute[71689]:   </sysinfo>
Apr 14 17:12:36 user nova-compute[71689]:   <os>
Apr 14 17:12:36 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:12:36 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:12:36 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:12:36 user nova-compute[71689]:   </os>
Apr 14 17:12:36 user nova-compute[71689]:   <features>
Apr 14 17:12:36 user nova-compute[71689]:     <acpi/>
Apr 14 17:12:36 user nova-compute[71689]:     <apic/>
Apr 14 17:12:36 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:12:36 user nova-compute[71689]:   </features>
Apr 14 17:12:36 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:12:36 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:12:36 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:12:36 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:12:36 user nova-compute[71689]:   </clock>
Apr 14 17:12:36 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:12:36 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:12:36 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:12:36 user nova-compute[71689]:   </cpu>
Apr 14 17:12:36 user nova-compute[71689]:   <devices>
Apr 14 17:12:36 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:12:36 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:12:36 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk"/>
Apr 14 17:12:36 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:12:36 user nova-compute[71689]:     </disk>
Apr 14 17:12:36 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:12:36 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:36 user nova-compute[71689]:       <source dev="/dev/sdd"/>
Apr 14 17:12:36 user nova-compute[71689]:       <target dev="vdc" bus="virtio"/>
Apr 14 17:12:36 user nova-compute[71689]:       <serial>37d0e1b4-870e-494c-bc85-ee2c56c4c81f</serial>
Apr 14 17:12:36 user nova-compute[71689]:     </disk>
Apr 14 17:12:36 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:12:36 user nova-compute[71689]:       <mac address="fa:16:3e:36:f6:67"/>
Apr 14 17:12:36 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:36 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:12:36 user nova-compute[71689]:       <target dev="tapf606ba05-7c"/>
Apr 14 17:12:36 user nova-compute[71689]:     </interface>
Apr 14 17:12:36 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:12:36 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/console.log" append="off"/>
Apr 14 17:12:36 user nova-compute[71689]:     </serial>
Apr 14 17:12:36 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:12:36 user nova-compute[71689]:     <video>
Apr 14 17:12:36 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:36 user nova-compute[71689]:     </video>
Apr 14 17:12:36 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:12:36 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:12:36 user nova-compute[71689]:     </rng>
Apr 14 17:12:36 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:12:36 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:12:36 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:12:36 user nova-compute[71689]:     </memballoon>
Apr 14 17:12:36 user nova-compute[71689]:   </devices>
Apr 14 17:12:36 user nova-compute[71689]: </domain>
Apr 14 17:12:36 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-955558461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-955558461',id=17,image_ref='6edf8916-1a2b-42eb-86f0-6a5af9f9405d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2086238855',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:08:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-a0vbjsvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member',shelved_at='2023-04-14T17:10:35.363859',shelved_host='user',shelved_image_id='6edf8916-1a2b-42eb-86f0-6a5af9f9405d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=a0fe02ed-b8cd-43ac-9210-d36e8c90de5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG os_vif [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf606ba05-7c, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf606ba05-7c, col_values=(('external_ids', {'iface-id': 'f606ba05-7c5e-4e88-94ed-a44a82cb8150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f6:67', 'vm-uuid': 'a0fe02ed-b8cd-43ac-9210-d36e8c90de5c'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:36 user nova-compute[71689]: INFO os_vif [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c')
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No VIF found with MAC fa:16:3e:36:f6:67, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:12:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:38 user nova-compute[71689]: WARNING nova.compute.manager [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 17:12:38 user nova-compute[71689]: INFO nova.compute.manager [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Rescuing
Apr 14 17:12:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:12:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-unplugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-unplugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:39 user nova-compute[71689]: WARNING nova.compute.manager [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-unplugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state active and task_state rescuing.
Apr 14 17:12:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance destroyed successfully.
Apr 14 17:12:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Attempting rescue
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71689) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:12:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Creating image(s)
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:39 user nova-compute[71689]: INFO nova.compute.manager [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Rescuing
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue" returned: 0 in 0.046s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'migration_context' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Start _get_guest_xml network_info=[{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:bf:ad:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'resources' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'numa_topology' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1925938594',display_name='tempest-ServerRescueNegativeTestJSON-server-1925938594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1925938594',id=20,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-r06rc0hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:56Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=5c01d750-5923-4b61-9f3a-17cf1142f0a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:bf:ad:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:bf:ad:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:12:40 user nova-compute[71689]:   <uuid>5c01d750-5923-4b61-9f3a-17cf1142f0a5</uuid>
Apr 14 17:12:40 user nova-compute[71689]:   <name>instance-00000014</name>
Apr 14 17:12:40 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:12:40 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:12:40 user nova-compute[71689]:   <metadata>
Apr 14 17:12:40 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:12:40 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:12:40 user nova-compute[71689]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1925938594</nova:name>
Apr 14 17:12:40 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:12:39</nova:creationTime>
Apr 14 17:12:40 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:12:40 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:12:40 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:12:40 user nova-compute[71689]:       <nova:owner>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:user uuid="2434278fe61447fab1f5a930aa16a1de">tempest-ServerRescueNegativeTestJSON-2056337871-project-member</nova:user>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:project uuid="070c6b9f620548b183904d1971f35752">tempest-ServerRescueNegativeTestJSON-2056337871</nova:project>
Apr 14 17:12:40 user nova-compute[71689]:       </nova:owner>
Apr 14 17:12:40 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:12:40 user nova-compute[71689]:       <nova:ports>
Apr 14 17:12:40 user nova-compute[71689]:         <nova:port uuid="1d44e719-ffdb-40ff-8b17-bf5d79e1df7e">
Apr 14 17:12:40 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 17:12:40 user nova-compute[71689]:         </nova:port>
Apr 14 17:12:40 user nova-compute[71689]:       </nova:ports>
Apr 14 17:12:40 user nova-compute[71689]:     </nova:instance>
Apr 14 17:12:40 user nova-compute[71689]:   </metadata>
Apr 14 17:12:40 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:12:40 user nova-compute[71689]:     <system>
Apr 14 17:12:40 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:12:40 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:12:40 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:12:40 user nova-compute[71689]:       <entry name="serial">5c01d750-5923-4b61-9f3a-17cf1142f0a5</entry>
Apr 14 17:12:40 user nova-compute[71689]:       <entry name="uuid">5c01d750-5923-4b61-9f3a-17cf1142f0a5</entry>
Apr 14 17:12:40 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:12:40 user nova-compute[71689]:     </system>
Apr 14 17:12:40 user nova-compute[71689]:   </sysinfo>
Apr 14 17:12:40 user nova-compute[71689]:   <os>
Apr 14 17:12:40 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:12:40 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:12:40 user nova-compute[71689]:   </os>
Apr 14 17:12:40 user nova-compute[71689]:   <features>
Apr 14 17:12:40 user nova-compute[71689]:     <acpi/>
Apr 14 17:12:40 user nova-compute[71689]:     <apic/>
Apr 14 17:12:40 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:12:40 user nova-compute[71689]:   </features>
Apr 14 17:12:40 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:12:40 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:12:40 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:12:40 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:12:40 user nova-compute[71689]:   </clock>
Apr 14 17:12:40 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:12:40 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:12:40 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:12:40 user nova-compute[71689]:   </cpu>
Apr 14 17:12:40 user nova-compute[71689]:   <devices>
Apr 14 17:12:40 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:12:40 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:12:40 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue"/>
Apr 14 17:12:40 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:12:40 user nova-compute[71689]:     </disk>
Apr 14 17:12:40 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:12:40 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:12:40 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk"/>
Apr 14 17:12:40 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:12:40 user nova-compute[71689]:     </disk>
Apr 14 17:12:40 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:12:40 user nova-compute[71689]:       <mac address="fa:16:3e:bf:ad:b2"/>
Apr 14 17:12:40 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:40 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:12:40 user nova-compute[71689]:       <target dev="tap1d44e719-ff"/>
Apr 14 17:12:40 user nova-compute[71689]:     </interface>
Apr 14 17:12:40 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:12:40 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/console.log" append="off"/>
Apr 14 17:12:40 user nova-compute[71689]:     </serial>
Apr 14 17:12:40 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:12:40 user nova-compute[71689]:     <video>
Apr 14 17:12:40 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:40 user nova-compute[71689]:     </video>
Apr 14 17:12:40 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:12:40 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:12:40 user nova-compute[71689]:     </rng>
Apr 14 17:12:40 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:12:40 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:12:40 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:12:40 user nova-compute[71689]:     </memballoon>
Apr 14 17:12:40 user nova-compute[71689]:   </devices>
Apr 14 17:12:40 user nova-compute[71689]: </domain>
Apr 14 17:12:40 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:12:40 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance destroyed successfully.
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:bf:ad:b2, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:40 user nova-compute[71689]: WARNING nova.compute.manager [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492360.315943, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:40 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] VM Resumed (Lifecycle Event)
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:40 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance spawned successfully.
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:40 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492360.3173018, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:40 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] VM Started (Lifecycle Event)
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:40 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.552s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:41 user nova-compute[71689]: WARNING nova.compute.manager [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state active and task_state rescuing.
Apr 14 17:12:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:41 user nova-compute[71689]: WARNING nova.compute.manager [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance destroyed successfully.
Apr 14 17:12:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Attempting a stable device rescue
Apr 14 17:12:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71689) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:12:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Creating image(s)
Apr 14 17:12:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "d10a48d4988a47760f42398df3e83f6888daaf28" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "d10a48d4988a47760f42398df3e83f6888daaf28" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.images [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 0ea3bcc0-6c41-4430-a140-49dd5b9a58cf was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.part /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.part /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.converted" returned: 0 in 0.276s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "d10a48d4988a47760f42398df3e83f6888daaf28" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.281s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "d10a48d4988a47760f42398df3e83f6888daaf28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "d10a48d4988a47760f42398df3e83f6888daaf28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28 --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28,backing_fmt=raw /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28,backing_fmt=raw /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue" returned: 0 in 0.049s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "d10a48d4988a47760f42398df3e83f6888daaf28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'migration_context' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Start _get_guest_xml network_info=[{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "vif_mac": "fa:16:3e:7d:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ea3bcc0-6c41-4430-a140-49dd5b9a58cf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1d1a580c-99da-46df-b02d-e2462d8ef26b', 'attached_at': '', 'detached_at': '', 'volume_id': '27d88a38-1e4b-4cfe-9e40-632022a9f510', 'serial': '27d88a38-1e4b-4cfe-9e40-632022a9f510'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1a29bc9f-142d-4070-ad0a-903af0681b7e', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'resources' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:43 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:12:43 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1549686-9a79-4165-9cd2-bbf22cc77361]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lTZiSeGn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 17:12:43 user nova-compute[71689]: node.name = iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:12:43 user nova-compute[71689]: node.tpgt = -1
Apr 14 17:12:43 user nova-compute[71689]: node.startup = automatic
Apr 14 17:12:43 user nova-compute[71689]: node.leading_login = No
Apr 14 17:12:43 user nova-compute[71689]: iface.iscsi_ifacename = default
Apr 14 17:12:43 user nova-compute[71689]: iface.net_ifacename = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.ipaddress = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.prefix_len = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.hwaddress = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.transport_name = tcp
Apr 14 17:12:43 user nova-compute[71689]: iface.initiatorname = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.vlan_id = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.vlan_priority = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.vlan_state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.iface_num = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.mtu = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.port = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.bootproto = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.subnet_mask = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.gateway = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_alt_client_id = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_dns = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_learn_iqn = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_vendor_id_state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_vendor_id = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.dhcp_slp_da = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.fragmentation = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.gratuitous_arp = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.incoming_forwarding = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.tos_state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.tos = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.ttl = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.delayed_ack = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.tcp_nagle = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.tcp_wsf_state = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.tcp_wsf = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.tcp_timer_scale = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.tcp_timestamp = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.redirect = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.def_task_mgmt_timeout = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.header_digest = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.data_digest = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.immediate_data = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.initial_r2t = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.data_seq_inorder = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.data_pdu_inorder = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.erl = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.max_receive_data_len = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.first_burst_len = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.max_outstanding_r2t = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.max_burst_len = 0
Apr 14 17:12:43 user nova-compute[71689]: iface.chap_auth = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.bidi_chap = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.strict_login_compliance = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.discovery_auth = <empty>
Apr 14 17:12:43 user nova-compute[71689]: iface.discovery_logout = <empty>
Apr 14 17:12:43 user nova-compute[71689]: node.discovery_address = <empty>
Apr 14 17:12:43 user nova-compute[71689]: node.discovery_port = 0
Apr 14 17:12:43 user nova-compute[71689]: node.discovery_type = static
Apr 14 17:12:43 user nova-compute[71689]: node.session.initial_cmdsn = 0
Apr 14 17:12:43 user nova-compute[71689]: node.session.initial_login_retry_max = 8
Apr 14 17:12:43 user nova-compute[71689]: node.session.xmit_thread_priority = -20
Apr 14 17:12:43 user nova-compute[71689]: node.session.cmds_max = 128
Apr 14 17:12:43 user nova-compute[71689]: node.session.queue_depth = 32
Apr 14 17:12:43 user nova-compute[71689]: node.session.nr_sessions = 1
Apr 14 17:12:43 user nova-compute[71689]: node.session.auth.authmethod = CHAP
Apr 14 17:12:43 user nova-compute[71689]: node.session.auth.username = lTZiSeGn
Apr 14 17:12:43 user nova-compute[71689]: node.session.auth.password = ***
Apr 14 17:12:43 user nova-compute[71689]: node.session.auth.username_in = <empty>
Apr 14 17:12:43 user nova-compute[71689]: node.session.auth.password_in = <empty>
Apr 14 17:12:43 user nova-compute[71689]: node.session.auth.chap_algs = MD5
Apr 14 17:12:43 user nova-compute[71689]: node.session.timeo.replacement_timeout = 120
Apr 14 17:12:43 user nova-compute[71689]: node.session.err_timeo.abort_timeout = 15
Apr 14 17:12:43 user nova-compute[71689]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 17:12:43 user nova-compute[71689]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 17:12:43 user nova-compute[71689]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.FastAbort = Yes
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.InitialR2T = No
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.ImmediateData = Yes
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.MaxConnections = 1
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 17:12:43 user nova-compute[71689]: node.session.iscsi.ERL = 0
Apr 14 17:12:43 user nova-compute[71689]: node.session.scan = manual
Apr 14 17:12:43 user nova-compute[71689]: node.session.reopen_max = 0
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].address = 172.16.0.220
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].port = 3260
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].startup = manual
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].tcp.window_size = 524288
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].tcp.type_of_service = 0
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].timeo.logout_timeout = 15
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].timeo.login_timeout = 15
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].timeo.auth_timeout = 45
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].iscsi.DataDigest = None
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].iscsi.IFMarker = No
Apr 14 17:12:43 user nova-compute[71689]: node.conn[0].iscsi.OFMarker = No
Apr 14 17:12:43 user nova-compute[71689]: # END RECORD
Apr 14 17:12:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b534f662-b695-4ac7-87d6-7742f46d687b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f41264-2f90-4e95-9df1-00ef8a6190a9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTZiSeGn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTZiSeGn" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ac3c2-20d1-4ac4-9b19-ecf6f1f750db]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTZiSeGn'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a86118-c028-4e33-9fc6-42124a14ce38]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc5c6b-02f8-45a4-bc79-caa467a67ca5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:43 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:43 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:12:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:12:43 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:12:43 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:12:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:12:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HCTL ('33', '0', '0', 0) found on session 19 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed87376-bc5c-4e1b-93ae-d26e646ee19e]: (4, ('0 0 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Searching for a device in session 19 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23830326339653534', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830326339653534', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1024645093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1024645093',id=21,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-dodatc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:11:07Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=1d1a580c-99da-46df-b02d-e2462d8ef26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "vif_mac": "fa:16:3e:7d:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "vif_mac": "fa:16:3e:7d:6e:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:12:44 user nova-compute[71689]:   <uuid>1d1a580c-99da-46df-b02d-e2462d8ef26b</uuid>
Apr 14 17:12:44 user nova-compute[71689]:   <name>instance-00000015</name>
Apr 14 17:12:44 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:12:44 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:12:44 user nova-compute[71689]:   <metadata>
Apr 14 17:12:44 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:12:44 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:12:44 user nova-compute[71689]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1024645093</nova:name>
Apr 14 17:12:44 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:12:43</nova:creationTime>
Apr 14 17:12:44 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:12:44 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:12:44 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:12:44 user nova-compute[71689]:       <nova:owner>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:user uuid="b5c86125160643958349100fb3a7855b">tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member</nova:user>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:project uuid="965bd22f61df40bd89e8ef35fb12bcd3">tempest-ServerBootFromVolumeStableRescueTest-995212803</nova:project>
Apr 14 17:12:44 user nova-compute[71689]:       </nova:owner>
Apr 14 17:12:44 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:12:44 user nova-compute[71689]:       <nova:ports>
Apr 14 17:12:44 user nova-compute[71689]:         <nova:port uuid="cc3e7d0d-e167-4a0d-b795-babe496d6f8d">
Apr 14 17:12:44 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:12:44 user nova-compute[71689]:         </nova:port>
Apr 14 17:12:44 user nova-compute[71689]:       </nova:ports>
Apr 14 17:12:44 user nova-compute[71689]:     </nova:instance>
Apr 14 17:12:44 user nova-compute[71689]:   </metadata>
Apr 14 17:12:44 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:12:44 user nova-compute[71689]:     <system>
Apr 14 17:12:44 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:12:44 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:12:44 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:12:44 user nova-compute[71689]:       <entry name="serial">1d1a580c-99da-46df-b02d-e2462d8ef26b</entry>
Apr 14 17:12:44 user nova-compute[71689]:       <entry name="uuid">1d1a580c-99da-46df-b02d-e2462d8ef26b</entry>
Apr 14 17:12:44 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:12:44 user nova-compute[71689]:     </system>
Apr 14 17:12:44 user nova-compute[71689]:   </sysinfo>
Apr 14 17:12:44 user nova-compute[71689]:   <os>
Apr 14 17:12:44 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:12:44 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:12:44 user nova-compute[71689]:   </os>
Apr 14 17:12:44 user nova-compute[71689]:   <features>
Apr 14 17:12:44 user nova-compute[71689]:     <acpi/>
Apr 14 17:12:44 user nova-compute[71689]:     <apic/>
Apr 14 17:12:44 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:12:44 user nova-compute[71689]:   </features>
Apr 14 17:12:44 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:12:44 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:12:44 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:12:44 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:12:44 user nova-compute[71689]:   </clock>
Apr 14 17:12:44 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:12:44 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:12:44 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:12:44 user nova-compute[71689]:   </cpu>
Apr 14 17:12:44 user nova-compute[71689]:   <devices>
Apr 14 17:12:44 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:12:44 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:12:44 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:12:44 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:12:44 user nova-compute[71689]:       <serial>27d88a38-1e4b-4cfe-9e40-632022a9f510</serial>
Apr 14 17:12:44 user nova-compute[71689]:     </disk>
Apr 14 17:12:44 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:12:44 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:12:44 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue"/>
Apr 14 17:12:44 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:12:44 user nova-compute[71689]:       <boot order="1"/>
Apr 14 17:12:44 user nova-compute[71689]:     </disk>
Apr 14 17:12:44 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:12:44 user nova-compute[71689]:       <mac address="fa:16:3e:7d:6e:78"/>
Apr 14 17:12:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:44 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:12:44 user nova-compute[71689]:       <target dev="tapcc3e7d0d-e1"/>
Apr 14 17:12:44 user nova-compute[71689]:     </interface>
Apr 14 17:12:44 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:12:44 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/console.log" append="off"/>
Apr 14 17:12:44 user nova-compute[71689]:     </serial>
Apr 14 17:12:44 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:12:44 user nova-compute[71689]:     <video>
Apr 14 17:12:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:12:44 user nova-compute[71689]:     </video>
Apr 14 17:12:44 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:12:44 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:12:44 user nova-compute[71689]:     </rng>
Apr 14 17:12:44 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:12:44 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:12:44 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:12:44 user nova-compute[71689]:     </memballoon>
Apr 14 17:12:44 user nova-compute[71689]:   </devices>
Apr 14 17:12:44 user nova-compute[71689]: </domain>
Apr 14 17:12:44 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:12:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance destroyed successfully.
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No VIF found with MAC fa:16:3e:7d:6e:78, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 5c01d750-5923-4b61-9f3a-17cf1142f0a5 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492364.3109496, 5c01d750-5923-4b61-9f3a-17cf1142f0a5 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] VM Resumed (Lifecycle Event)
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492364.311057, 5c01d750-5923-4b61-9f3a-17cf1142f0a5 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] VM Started (Lifecycle Event)
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:45 user nova-compute[71689]: WARNING nova.compute.manager [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 1d1a580c-99da-46df-b02d-e2462d8ef26b due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492367.8746958, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Resumed (Lifecycle Event)
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:12:47 user nova-compute[71689]: WARNING nova.compute.manager [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state rescuing.
Apr 14 17:12:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492367.8780806, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:12:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Started (Lifecycle Event)
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:12:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:12:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:12:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:00 user nova-compute[71689]: INFO nova.compute.manager [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Terminating instance
Apr 14 17:13:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-vif-unplugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] No waiting events found dispatching network-vif-unplugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:13:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-vif-unplugged-84d1f2c3-e095-4535-92c3-9ff189992179 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Instance destroyed successfully.
Apr 14 17:13:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'resources' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-128880765',display_name='tempest-AttachVolumeNegativeTest-server-128880765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-128880765',id=18,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTdefih26p4VWLlEtU9B5X8kXev8KrkLhnDrViyCkzWshAjGw+6zUvio9aNibzsCRg3M8zqQXAtV/jSH9vT630W3rFV6Oo2EOMEB51kmqtYD1qr26uKQ8UwWYLpsALnQ==',key_name='tempest-keypair-2060261619',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:10:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-mksdki93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=7213d0b2-6eac-449b-aa4b-44088686abac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "84d1f2c3-e095-4535-92c3-9ff189992179", "address": "fa:16:3e:e2:00:5e", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d1f2c3-e0", "ovs_interfaceid": "84d1f2c3-e095-4535-92c3-9ff189992179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG os_vif [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d1f2c3-e0, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:13:01 user nova-compute[71689]: INFO os_vif [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:00:5e,bridge_name='br-int',has_traffic_filtering=True,id=84d1f2c3-e095-4535-92c3-9ff189992179,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d1f2c3-e0')
Apr 14 17:13:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Deleting instance files /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac_del
Apr 14 17:13:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Deletion of /opt/stack/data/nova/instances/7213d0b2-6eac-449b-aa4b-44088686abac_del complete
Apr 14 17:13:01 user nova-compute[71689]: INFO nova.compute.manager [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 17:13:01 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:13:01 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:02 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Took 0.88 seconds to deallocate network for instance.
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-vif-deleted-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:02 user nova-compute[71689]: INFO nova.compute.manager [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Neutron deleted interface 84d1f2c3-e095-4535-92c3-9ff189992179; detaching it from the instance and deleting it from the info cache
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Detach interface failed, port_id=84d1f2c3-e095-4535-92c3-9ff189992179, reason: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:02 user nova-compute[71689]: INFO nova.compute.manager [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Terminating instance
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:02 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Deleted allocations for instance 7213d0b2-6eac-449b-aa4b-44088686abac
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7213d0b2-6eac-449b-aa4b-44088686abac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received event network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Acquiring lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Lock "7213d0b2-6eac-449b-aa4b-44088686abac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] No waiting events found dispatching network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:13:02 user nova-compute[71689]: WARNING nova.compute.manager [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Received unexpected event network-vif-plugged-84d1f2c3-e095-4535-92c3-9ff189992179 for instance with vm_state deleted and task_state None.
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:13:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-unplugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:13:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Instance destroyed successfully.
Apr 14 17:13:03 user nova-compute[71689]: DEBUG nova.objects.instance [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'resources' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1946928573',display_name='tempest-AttachVolumeTestJSON-server-1946928573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1946928573',id=3,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA==',key_name='tempest-keypair-953990957',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-zmlqu5c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=d68b702a-a0dc-4030-9893-87b4ef44fb97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "address": "fa:16:3e:bf:7d:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed5f4a5-3c", "ovs_interfaceid": "6ed5f4a5-3c4e-48f6-8667-efda89e23575", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG os_vif [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed5f4a5-3c, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:13:03 user nova-compute[71689]: INFO os_vif [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:7d:0c,bridge_name='br-int',has_traffic_filtering=True,id=6ed5f4a5-3c4e-48f6-8667-efda89e23575,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed5f4a5-3c')
Apr 14 17:13:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Deleting instance files /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97_del
Apr 14 17:13:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Deletion of /opt/stack/data/nova/instances/d68b702a-a0dc-4030-9893-87b4ef44fb97_del complete
Apr 14 17:13:03 user nova-compute[71689]: INFO nova.compute.manager [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 14 17:13:03 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:13:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:04 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Took 0.91 seconds to deallocate network for instance.
Apr 14 17:13:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-deleted-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:04 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Deleted allocations for instance d68b702a-a0dc-4030-9893-87b4ef44fb97
Apr 14 17:13:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Acquiring lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Lock "d68b702a-a0dc-4030-9893-87b4ef44fb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] No waiting events found dispatching network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:13:05 user nova-compute[71689]: WARNING nova.compute.manager [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Received unexpected event network-vif-plugged-6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance with vm_state deleted and task_state None.
Apr 14 17:13:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:16 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492381.3923724, 7213d0b2-6eac-449b-aa4b-44088686abac => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:13:16 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] VM Stopped (Lifecycle Event)
Apr 14 17:13:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c55c94ae-1bca-4c43-87a3-92344d844081 None None] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:13:18 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492383.1389964, d68b702a-a0dc-4030-9893-87b4ef44fb97 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:13:18 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] VM Stopped (Lifecycle Event)
Apr 14 17:13:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f6549df8-f632-486c-9e4c-a99e6d2b2fb9 None None] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:13:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:21 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:13:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:28 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:13:28 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=26.30026626586914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:13:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:32 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:34 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:13:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:13:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG nova.objects.instance [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'flavor' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:40 user nova-compute[71689]: INFO nova.compute.manager [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Attaching volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f to /dev/vdb
Apr 14 17:13:40 user nova-compute[71689]: DEBUG os_brick.utils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[719105c6-8723-4c66-823b-dc7db6c361a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afbd87a-a4b7-4a1e-8aa3-0291863915d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f0ce1b-d1bc-4893-b718-aa52a1841053]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419818f-2ae2-44fe-86f3-825c7361c461]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:13:40 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:13:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d647302-4380-42e1-aba9-a4a1d1b43dd5]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG os_brick.utils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:13:40 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating existing volume attachment record: ed30e2fb-f9c4-4570-a8df-9af1f607f5ec {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:13:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:13:48 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:13:48 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:13:48 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e9a173-eb53-474d-83f0-5990d8c305d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:13:48 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a1460-6f1d-47b3-aa01-621df3dd0444]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f] added
Apr 14 17:13:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5315edfc-6a4c-437f-b104-f7f6c66b78f8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0c8bb7-1205-4a0d-bf61-6f4cdce5030e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTNPJMbC {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTNPJMbC" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a28e94b-6a0e-43e3-b7e7-8fe6a11beb6c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTNPJMbC'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6560bb8a-dbde-4312-a877-804fb11b9751]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[240bede2-386b-4926-8a15-96b6d46846bb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:13:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:13:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d2a459-4a45-4300-b60d-d888e6809a56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]
Apr 14 17:13:48 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.
Apr 14 17:13:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[403619f6-7909-4fe6-88bf-0cb3a51b2105]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a84840-73bf-4de3-824f-1061bd2dcd25]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:13:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:13:48 user nova-compute[71689]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:13:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f9937a-d65f-48e8-ab73-806aa7f68d45]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:13:48 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26236623734316234', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236623734316234', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'flavor' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:13:49 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:13:49 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:13:49 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:13:49 user nova-compute[71689]:   <serial>d702ef9d-11a4-4a6f-81c8-6d132b21f55f</serial>
Apr 14 17:13:49 user nova-compute[71689]: </disk>
Apr 14 17:13:49 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No VIF found with MAC fa:16:3e:e3:7a:9b, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.208s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:13:50 user nova-compute[71689]: INFO nova.compute.claims [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Claim successful on node user
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:13:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.policy [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:13:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Creating image(s)
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "/opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "/opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "/opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk 1073741824" returned: 0 in 0.053s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:13:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Cannot resize image /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lazy-loading 'migration_context' on Instance uuid 64126eba-a43a-4dfe-922b-fc89b1fc8d05 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Ensure instance console log exists: /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:52 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Successfully created port: a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Successfully updated port: a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "refresh_cache-64126eba-a43a-4dfe-922b-fc89b1fc8d05" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquired lock "refresh_cache-64126eba-a43a-4dfe-922b-fc89b1fc8d05" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-changed-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Refreshing instance network info cache due to event network-changed-a7de6551-769f-44f1-8f5f-edc66e5ef5f1. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Acquiring lock "refresh_cache-64126eba-a43a-4dfe-922b-fc89b1fc8d05" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Updating instance_info_cache with network_info: [{"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Releasing lock "refresh_cache-64126eba-a43a-4dfe-922b-fc89b1fc8d05" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Instance network_info: |[{"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Acquired lock "refresh_cache-64126eba-a43a-4dfe-922b-fc89b1fc8d05" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.neutron [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Refreshing network info cache for port a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Start _get_guest_xml network_info=[{"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:13:53 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:13:53 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2011999242',display_name='tempest-VolumesActionsTest-instance-2011999242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2011999242',id=23,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ed93a0cc2a4b2689cd9d26b7f73a14',ramdisk_id='',reservation_id='r-1pdf9awz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-355349757',owner_user_name='tempest-VolumesActionsTest-355349757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:13:51Z,user_data=None,user_id='8312ebadc8bf438dbc01dc42c6257a08',uuid=64126eba-a43a-4dfe-922b-fc89b1fc8d05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converting VIF {"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lazy-loading 'pci_devices' on Instance uuid 64126eba-a43a-4dfe-922b-fc89b1fc8d05 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:13:53 user nova-compute[71689]:   <uuid>64126eba-a43a-4dfe-922b-fc89b1fc8d05</uuid>
Apr 14 17:13:53 user nova-compute[71689]:   <name>instance-00000017</name>
Apr 14 17:13:53 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:13:53 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:13:53 user nova-compute[71689]:   <metadata>
Apr 14 17:13:53 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:13:53 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:13:53 user nova-compute[71689]:       <nova:name>tempest-VolumesActionsTest-instance-2011999242</nova:name>
Apr 14 17:13:53 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:13:53</nova:creationTime>
Apr 14 17:13:53 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:13:53 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:13:53 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:13:53 user nova-compute[71689]:       <nova:owner>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:user uuid="8312ebadc8bf438dbc01dc42c6257a08">tempest-VolumesActionsTest-355349757-project-member</nova:user>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:project uuid="65ed93a0cc2a4b2689cd9d26b7f73a14">tempest-VolumesActionsTest-355349757</nova:project>
Apr 14 17:13:53 user nova-compute[71689]:       </nova:owner>
Apr 14 17:13:53 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:13:53 user nova-compute[71689]:       <nova:ports>
Apr 14 17:13:53 user nova-compute[71689]:         <nova:port uuid="a7de6551-769f-44f1-8f5f-edc66e5ef5f1">
Apr 14 17:13:53 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 14 17:13:53 user nova-compute[71689]:         </nova:port>
Apr 14 17:13:53 user nova-compute[71689]:       </nova:ports>
Apr 14 17:13:53 user nova-compute[71689]:     </nova:instance>
Apr 14 17:13:53 user nova-compute[71689]:   </metadata>
Apr 14 17:13:53 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:13:53 user nova-compute[71689]:     <system>
Apr 14 17:13:53 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:13:53 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:13:53 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:13:53 user nova-compute[71689]:       <entry name="serial">64126eba-a43a-4dfe-922b-fc89b1fc8d05</entry>
Apr 14 17:13:53 user nova-compute[71689]:       <entry name="uuid">64126eba-a43a-4dfe-922b-fc89b1fc8d05</entry>
Apr 14 17:13:53 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:13:53 user nova-compute[71689]:     </system>
Apr 14 17:13:53 user nova-compute[71689]:   </sysinfo>
Apr 14 17:13:53 user nova-compute[71689]:   <os>
Apr 14 17:13:53 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:13:53 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:13:53 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:13:53 user nova-compute[71689]:   </os>
Apr 14 17:13:53 user nova-compute[71689]:   <features>
Apr 14 17:13:53 user nova-compute[71689]:     <acpi/>
Apr 14 17:13:53 user nova-compute[71689]:     <apic/>
Apr 14 17:13:53 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:13:53 user nova-compute[71689]:   </features>
Apr 14 17:13:53 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:13:53 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:13:53 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:13:53 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:13:53 user nova-compute[71689]:   </clock>
Apr 14 17:13:53 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:13:53 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:13:53 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:13:53 user nova-compute[71689]:   </cpu>
Apr 14 17:13:53 user nova-compute[71689]:   <devices>
Apr 14 17:13:53 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:13:53 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:13:53 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk"/>
Apr 14 17:13:53 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:13:53 user nova-compute[71689]:     </disk>
Apr 14 17:13:53 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:13:53 user nova-compute[71689]:       <mac address="fa:16:3e:8c:7d:00"/>
Apr 14 17:13:53 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:13:53 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:13:53 user nova-compute[71689]:       <target dev="tapa7de6551-76"/>
Apr 14 17:13:53 user nova-compute[71689]:     </interface>
Apr 14 17:13:53 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:13:53 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/console.log" append="off"/>
Apr 14 17:13:53 user nova-compute[71689]:     </serial>
Apr 14 17:13:53 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:13:53 user nova-compute[71689]:     <video>
Apr 14 17:13:53 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:13:53 user nova-compute[71689]:     </video>
Apr 14 17:13:53 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:13:53 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:13:53 user nova-compute[71689]:     </rng>
Apr 14 17:13:53 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:13:53 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:13:53 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:13:53 user nova-compute[71689]:     </memballoon>
Apr 14 17:13:53 user nova-compute[71689]:   </devices>
Apr 14 17:13:53 user nova-compute[71689]: </domain>
Apr 14 17:13:53 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2011999242',display_name='tempest-VolumesActionsTest-instance-2011999242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2011999242',id=23,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ed93a0cc2a4b2689cd9d26b7f73a14',ramdisk_id='',reservation_id='r-1pdf9awz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-355349757',owner_user_name='tempest-VolumesActionsTest-355349757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:13:51Z,user_data=None,user_id='8312ebadc8bf438dbc01dc42c6257a08',uuid=64126eba-a43a-4dfe-922b-fc89b1fc8d05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converting VIF {"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG os_vif [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7de6551-76, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7de6551-76, col_values=(('external_ids', {'iface-id': 'a7de6551-769f-44f1-8f5f-edc66e5ef5f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:7d:00', 'vm-uuid': '64126eba-a43a-4dfe-922b-fc89b1fc8d05'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:53 user nova-compute[71689]: INFO os_vif [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76')
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:13:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] No VIF found with MAC fa:16:3e:8c:7d:00, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:13:54 user nova-compute[71689]: DEBUG nova.network.neutron [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Updated VIF entry in instance network info cache for port a7de6551-769f-44f1-8f5f-edc66e5ef5f1. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:13:54 user nova-compute[71689]: DEBUG nova.network.neutron [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Updating instance_info_cache with network_info: [{"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Releasing lock "refresh_cache-64126eba-a43a-4dfe-922b-fc89b1fc8d05" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:13:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] No waiting events found dispatching network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:13:55 user nova-compute[71689]: WARNING nova.compute.manager [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received unexpected event network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance with vm_state building and task_state spawning.
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:55 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:13:55 user nova-compute[71689]: INFO nova.compute.claims [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Claim successful on node user
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:13:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.policy [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:13:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Creating image(s)
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "/opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "/opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.163s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk 1073741824" returned: 0 in 0.064s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492437.1626654, 64126eba-a43a-4dfe-922b-fc89b1fc8d05 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] VM Resumed (Lifecycle Event)
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Successfully created port: 74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Instance spawned successfully.
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492437.1642354, 64126eba-a43a-4dfe-922b-fc89b1fc8d05 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] VM Started (Lifecycle Event)
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Cannot resize image /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.objects.instance [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'migration_context' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Ensure instance console log exists: /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:13:57 user nova-compute[71689]: INFO nova.compute.manager [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Took 6.54 seconds to build instance.
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.646s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] No waiting events found dispatching network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:13:57 user nova-compute[71689]: WARNING nova.compute.manager [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received unexpected event network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance with vm_state active and task_state None.
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing instance network info cache due to event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:57 user nova-compute[71689]: DEBUG nova.network.neutron [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.neutron [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updated VIF entry in instance network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.neutron [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Successfully updated port: 74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquired lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updating instance_info_cache with network_info: [{"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Releasing lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Instance network_info: |[{"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Start _get_guest_xml network_info=[{"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:13:58 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:13:58 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824688479',display_name='tempest-AttachVolumeNegativeTest-server-1824688479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1824688479',id=24,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiAzZy9dK3YblixiueVEZjNo3Yf/Mse2QN0h6OPOOvKGQHCpmIShPfBNrSnB3HhcPcnWcV0+yoNiILxw9YMH9tL3wdLVIiHbJ+m1obAVawIKBAO8XvsM6rixZ+hO9LV7A==',key_name='tempest-keypair-154124342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-5ewcnkkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=c85ab15f-39ed-43cc-bbdf-b030dd21d860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.objects.instance [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'pci_devices' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:13:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:13:58 user nova-compute[71689]:   <uuid>c85ab15f-39ed-43cc-bbdf-b030dd21d860</uuid>
Apr 14 17:13:58 user nova-compute[71689]:   <name>instance-00000018</name>
Apr 14 17:13:58 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:13:58 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:13:58 user nova-compute[71689]:   <metadata>
Apr 14 17:13:58 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:13:58 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:13:58 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1824688479</nova:name>
Apr 14 17:13:58 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:13:58</nova:creationTime>
Apr 14 17:13:58 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:13:58 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:13:58 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:13:58 user nova-compute[71689]:       <nova:owner>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:user uuid="d9c9e0d318eb4ca49d47d620682fb00a">tempest-AttachVolumeNegativeTest-1177875221-project-member</nova:user>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:project uuid="6f341a2096b9483787b569a59f325556">tempest-AttachVolumeNegativeTest-1177875221</nova:project>
Apr 14 17:13:58 user nova-compute[71689]:       </nova:owner>
Apr 14 17:13:58 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:13:58 user nova-compute[71689]:       <nova:ports>
Apr 14 17:13:58 user nova-compute[71689]:         <nova:port uuid="74eca994-ff43-4b06-89f4-fa4bae9c4b90">
Apr 14 17:13:58 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 17:13:58 user nova-compute[71689]:         </nova:port>
Apr 14 17:13:58 user nova-compute[71689]:       </nova:ports>
Apr 14 17:13:58 user nova-compute[71689]:     </nova:instance>
Apr 14 17:13:58 user nova-compute[71689]:   </metadata>
Apr 14 17:13:58 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:13:58 user nova-compute[71689]:     <system>
Apr 14 17:13:58 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:13:58 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:13:58 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:13:58 user nova-compute[71689]:       <entry name="serial">c85ab15f-39ed-43cc-bbdf-b030dd21d860</entry>
Apr 14 17:13:58 user nova-compute[71689]:       <entry name="uuid">c85ab15f-39ed-43cc-bbdf-b030dd21d860</entry>
Apr 14 17:13:58 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:13:58 user nova-compute[71689]:     </system>
Apr 14 17:13:58 user nova-compute[71689]:   </sysinfo>
Apr 14 17:13:58 user nova-compute[71689]:   <os>
Apr 14 17:13:58 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:13:58 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:13:58 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:13:58 user nova-compute[71689]:   </os>
Apr 14 17:13:58 user nova-compute[71689]:   <features>
Apr 14 17:13:58 user nova-compute[71689]:     <acpi/>
Apr 14 17:13:58 user nova-compute[71689]:     <apic/>
Apr 14 17:13:58 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:13:58 user nova-compute[71689]:   </features>
Apr 14 17:13:58 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:13:58 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:13:58 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:13:58 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:13:58 user nova-compute[71689]:   </clock>
Apr 14 17:13:58 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:13:58 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:13:58 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:13:58 user nova-compute[71689]:   </cpu>
Apr 14 17:13:58 user nova-compute[71689]:   <devices>
Apr 14 17:13:58 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:13:58 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:13:58 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk"/>
Apr 14 17:13:58 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:13:58 user nova-compute[71689]:     </disk>
Apr 14 17:13:58 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:13:58 user nova-compute[71689]:       <mac address="fa:16:3e:53:b0:45"/>
Apr 14 17:13:58 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:13:58 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:13:58 user nova-compute[71689]:       <target dev="tap74eca994-ff"/>
Apr 14 17:13:58 user nova-compute[71689]:     </interface>
Apr 14 17:13:58 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:13:58 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/console.log" append="off"/>
Apr 14 17:13:58 user nova-compute[71689]:     </serial>
Apr 14 17:13:58 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:13:58 user nova-compute[71689]:     <video>
Apr 14 17:13:58 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:13:58 user nova-compute[71689]:     </video>
Apr 14 17:13:58 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:13:58 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:13:58 user nova-compute[71689]:     </rng>
Apr 14 17:13:58 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:13:58 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:13:58 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:13:58 user nova-compute[71689]:     </memballoon>
Apr 14 17:13:58 user nova-compute[71689]:   </devices>
Apr 14 17:13:58 user nova-compute[71689]: </domain>
Apr 14 17:13:58 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824688479',display_name='tempest-AttachVolumeNegativeTest-server-1824688479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1824688479',id=24,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiAzZy9dK3YblixiueVEZjNo3Yf/Mse2QN0h6OPOOvKGQHCpmIShPfBNrSnB3HhcPcnWcV0+yoNiILxw9YMH9tL3wdLVIiHbJ+m1obAVawIKBAO8XvsM6rixZ+hO9LV7A==',key_name='tempest-keypair-154124342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-5ewcnkkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=c85ab15f-39ed-43cc-bbdf-b030dd21d860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG os_vif [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74eca994-ff, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74eca994-ff, col_values=(('external_ids', {'iface-id': '74eca994-ff43-4b06-89f4-fa4bae9c4b90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b0:45', 'vm-uuid': 'c85ab15f-39ed-43cc-bbdf-b030dd21d860'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:59 user nova-compute[71689]: INFO os_vif [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff')
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:53:b0:45, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:13:59 user nova-compute[71689]: INFO nova.compute.claims [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Claim successful on node user
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-changed-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Refreshing instance network info cache due to event network-changed-74eca994-ff43-4b06-89f4-fa4bae9c4b90. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Acquiring lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Acquired lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Refreshing network info cache for port 74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:13:59 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing instance network info cache due to event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.policy [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:13:59 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Creating image(s)
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "/opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "/opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:13:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.179s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.network.neutron [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updated VIF entry in instance network info cache for port 74eca994-ff43-4b06-89f4-fa4bae9c4b90. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.network.neutron [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updating instance_info_cache with network_info: [{"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Releasing lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk 1073741824" returned: 0 in 0.058s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.network.neutron [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updated VIF entry in instance network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.network.neutron [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.177s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Successfully created port: e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Cannot resize image /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'migration_context' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Ensure instance console log exists: /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Successfully updated port: e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquired lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-changed-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Refreshing instance network info cache due to event network-changed-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Acquiring lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updating instance_info_cache with network_info: [{"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Releasing lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Instance network_info: |[{"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Acquired lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.neutron [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Refreshing network info cache for port e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Start _get_guest_xml network_info=[{"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:01 user nova-compute[71689]: WARNING nova.compute.manager [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state building and task_state spawning.
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.compute.manager [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:01 user nova-compute[71689]: WARNING nova.compute.manager [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state building and task_state spawning.
Apr 14 17:14:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:14:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1995210077',display_name='tempest-AttachVolumeTestJSON-server-1995210077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1995210077',id=25,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0uW0bfc2VtorRe+2+EDqsDVec89xkRAc5iKeALuOkKQ8tOYj6wSac/VyJ2lUwhS8eUsyWL9lTocWKwpfOk7Q4YvVGlOSCvR4MzeuEWa3Q8l7EFB4rmzP5clCT67VI6jQ==',key_name='tempest-keypair-1936947036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-20cbmd6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=0d06e72a-65dd-433d-bc13-6550fb85a123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:14:01 user nova-compute[71689]:   <uuid>0d06e72a-65dd-433d-bc13-6550fb85a123</uuid>
Apr 14 17:14:01 user nova-compute[71689]:   <name>instance-00000019</name>
Apr 14 17:14:01 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:14:01 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:14:01 user nova-compute[71689]:   <metadata>
Apr 14 17:14:01 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:14:01 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:14:01 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeTestJSON-server-1995210077</nova:name>
Apr 14 17:14:01 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:14:01</nova:creationTime>
Apr 14 17:14:01 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:14:01 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:14:01 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:14:01 user nova-compute[71689]:       <nova:owner>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:user uuid="d7c4734925f645248b0f9060aa78a502">tempest-AttachVolumeTestJSON-917907278-project-member</nova:user>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:project uuid="0c8f6b39515e456c9f5a1affa9f79000">tempest-AttachVolumeTestJSON-917907278</nova:project>
Apr 14 17:14:01 user nova-compute[71689]:       </nova:owner>
Apr 14 17:14:01 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:14:01 user nova-compute[71689]:       <nova:ports>
Apr 14 17:14:01 user nova-compute[71689]:         <nova:port uuid="e9809ce5-c37b-4fdc-9c1b-50e204c9ad37">
Apr 14 17:14:01 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:14:01 user nova-compute[71689]:         </nova:port>
Apr 14 17:14:01 user nova-compute[71689]:       </nova:ports>
Apr 14 17:14:01 user nova-compute[71689]:     </nova:instance>
Apr 14 17:14:01 user nova-compute[71689]:   </metadata>
Apr 14 17:14:01 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:14:01 user nova-compute[71689]:     <system>
Apr 14 17:14:01 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:14:01 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:14:01 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:14:01 user nova-compute[71689]:       <entry name="serial">0d06e72a-65dd-433d-bc13-6550fb85a123</entry>
Apr 14 17:14:01 user nova-compute[71689]:       <entry name="uuid">0d06e72a-65dd-433d-bc13-6550fb85a123</entry>
Apr 14 17:14:01 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:14:01 user nova-compute[71689]:     </system>
Apr 14 17:14:01 user nova-compute[71689]:   </sysinfo>
Apr 14 17:14:01 user nova-compute[71689]:   <os>
Apr 14 17:14:01 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:14:01 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:14:01 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:14:01 user nova-compute[71689]:   </os>
Apr 14 17:14:01 user nova-compute[71689]:   <features>
Apr 14 17:14:01 user nova-compute[71689]:     <acpi/>
Apr 14 17:14:01 user nova-compute[71689]:     <apic/>
Apr 14 17:14:01 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:14:01 user nova-compute[71689]:   </features>
Apr 14 17:14:01 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:14:01 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:14:01 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:14:01 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:14:01 user nova-compute[71689]:   </clock>
Apr 14 17:14:01 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:14:01 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:14:01 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:14:01 user nova-compute[71689]:   </cpu>
Apr 14 17:14:01 user nova-compute[71689]:   <devices>
Apr 14 17:14:01 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:14:01 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:14:01 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk"/>
Apr 14 17:14:01 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:14:01 user nova-compute[71689]:     </disk>
Apr 14 17:14:01 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:14:01 user nova-compute[71689]:       <mac address="fa:16:3e:d5:bf:0c"/>
Apr 14 17:14:01 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:14:01 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:14:01 user nova-compute[71689]:       <target dev="tape9809ce5-c3"/>
Apr 14 17:14:01 user nova-compute[71689]:     </interface>
Apr 14 17:14:01 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:14:01 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/console.log" append="off"/>
Apr 14 17:14:01 user nova-compute[71689]:     </serial>
Apr 14 17:14:01 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:14:01 user nova-compute[71689]:     <video>
Apr 14 17:14:01 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:14:01 user nova-compute[71689]:     </video>
Apr 14 17:14:01 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:14:01 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:14:01 user nova-compute[71689]:     </rng>
Apr 14 17:14:01 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:14:01 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:14:01 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:14:01 user nova-compute[71689]:     </memballoon>
Apr 14 17:14:01 user nova-compute[71689]:   </devices>
Apr 14 17:14:01 user nova-compute[71689]: </domain>
Apr 14 17:14:01 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1995210077',display_name='tempest-AttachVolumeTestJSON-server-1995210077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1995210077',id=25,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0uW0bfc2VtorRe+2+EDqsDVec89xkRAc5iKeALuOkKQ8tOYj6wSac/VyJ2lUwhS8eUsyWL9lTocWKwpfOk7Q4YvVGlOSCvR4MzeuEWa3Q8l7EFB4rmzP5clCT67VI6jQ==',key_name='tempest-keypair-1936947036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-20cbmd6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=0d06e72a-65dd-433d-bc13-6550fb85a123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG os_vif [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9809ce5-c3, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9809ce5-c3, col_values=(('external_ids', {'iface-id': 'e9809ce5-c37b-4fdc-9c1b-50e204c9ad37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:bf:0c', 'vm-uuid': '0d06e72a-65dd-433d-bc13-6550fb85a123'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:01 user nova-compute[71689]: INFO os_vif [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3')
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:14:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No VIF found with MAC fa:16:3e:d5:bf:0c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updated VIF entry in instance network info cache for port e9809ce5-c37b-4fdc-9c1b-50e204c9ad37. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updating instance_info_cache with network_info: [{"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Releasing lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492442.7086163, c85ab15f-39ed-43cc-bbdf-b030dd21d860 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] VM Resumed (Lifecycle Event)
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Instance spawned successfully.
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492442.7097673, c85ab15f-39ed-43cc-bbdf-b030dd21d860 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] VM Started (Lifecycle Event)
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Took 6.26 seconds to spawn the instance on the hypervisor.
Apr 14 17:14:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:14:02 user nova-compute[71689]: INFO nova.compute.manager [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Took 6.99 seconds to build instance.
Apr 14 17:14:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.089s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:03 user nova-compute[71689]: INFO nova.compute.manager [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Rebooting instance
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] No waiting events found dispatching network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:03 user nova-compute[71689]: WARNING nova.compute.manager [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received unexpected event network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance with vm_state building and task_state spawning.
Apr 14 17:14:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-unplugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-unplugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:04 user nova-compute[71689]: WARNING nova.compute.manager [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-unplugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 17:14:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance destroyed successfully.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'resources' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1774561863',display_name='tempest-TestMinimumBasicScenario-server-1774561863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1774561863',id=22,image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg==',key_name='tempest-TestMinimumBasicScenario-117998537',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-qq80e7pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:14:04Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=35dee18b-ac00-4f46-813e-7a7b400cdba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4295b114-8b, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:14:05 user nova-compute[71689]: INFO os_vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b')
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:14:05 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d7a8fc-3379-40f3-88e2-680e30ded31c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:14:05 user nova-compute[71689]: No targets found.
Apr 14 17:14:05 user nova-compute[71689]: iSNS:
Apr 14 17:14:05 user nova-compute[71689]: No targets found.
Apr 14 17:14:05 user nova-compute[71689]: STATIC:
Apr 14 17:14:05 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:14:05 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:05 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:05 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f
Apr 14 17:14:05 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:05 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:05 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:14:05 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:05 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:05 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f
Apr 14 17:14:05 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:05 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:05 user nova-compute[71689]: FIRMWARE:
Apr 14 17:14:05 user nova-compute[71689]: No targets found.
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:14:05 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:14:05 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d1bba2-0ab1-4ed0-a209-d4e1706c0c1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c8dbd-c221-4a99-b634-f7ee3b392e57]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c2160e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[72285f76-e1e5-4f4e-bb54-6711d3e50199]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96d817-43e0-41c5-abe2-18eabfdf3267]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[128fc11a-ca14-4374-9301-3bd4230a13cf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[99584e8a-dd62-4a9c-9131-8cac72198351]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf041a6-d341-453b-9ef2-a6dc8e154d1a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a0d4d9-305e-4a03-b5cd-abf95d71ddf8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]
Apr 14 17:14:05 user nova-compute[71689]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e32de2-5dfa-4a21-9fa1-ed79807725ab]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== disconnect_volume: return (322ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Start _get_guest_xml network_info=[{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2575725f-bb4e-408e-8718-10139aaf6e19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': '2575725f-bb4e-408e-8718-10139aaf6e19'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '35dee18b-ac00-4f46-813e-7a7b400cdba5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'serial': 'd702ef9d-11a4-4a6f-81c8-6d132b21f55f'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ed30e2fb-f9c4-4570-a8df-9af1f607f5ec', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:14:05 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:14:05 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2575725f-bb4e-408e-8718-10139aaf6e19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:14:05 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:14:05 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:14:05 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af348f-7c9a-4d70-a1ea-3fa529bd3827]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:14:05 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f0ae87-8a56-427a-818b-2464c086f057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f] added
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[774b1a77-c3c6-4bc4-bd42-a05bbf9feea5]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[818fde9a-f213-41ff-a5be-3b510de70420]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTNPJMbC {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492445.653128, 0d06e72a-65dd-433d-bc13-6550fb85a123 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] VM Resumed (Lifecycle Event)
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Instance spawned successfully.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTNPJMbC" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b85dbcd-7b11-4764-af2e-184030cac3a1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTNPJMbC'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c836fb-a701-49fe-9f6e-84229f7f256c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492445.6561992, 0d06e72a-65dd-433d-bc13-6550fb85a123 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] VM Started (Lifecycle Event)
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[56948c03-394e-430d-88c0-fb36f8d86920]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78eb985-8d35-4201-9874-29d0e9f19354]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]
Apr 14 17:14:05 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Took 5.96 seconds to spawn the instance on the hypervisor.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b73d62-4c93-46b1-866e-488ef170fde2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f387fbe-dd4d-460c-9b96-b524741d5760]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:14:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:05 user nova-compute[71689]: INFO nova.compute.manager [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Took 6.80 seconds to build instance.
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51cd8c-7e34-47dd-8a24-4e4a470211d6]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.918s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] No waiting events found dispatching network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:05 user nova-compute[71689]: WARNING nova.compute.manager [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received unexpected event network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance with vm_state active and task_state None.
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:06 user nova-compute[71689]: WARNING nova.compute.manager [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 17:14:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26236623734316234', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236623734316234', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1774561863',display_name='tempest-TestMinimumBasicScenario-server-1774561863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1774561863',id=22,image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg==',key_name='tempest-TestMinimumBasicScenario-117998537',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-qq80e7pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:14:04Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=35dee18b-ac00-4f46-813e-7a7b400cdba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'pci_devices' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:14:06 user nova-compute[71689]:   <uuid>35dee18b-ac00-4f46-813e-7a7b400cdba5</uuid>
Apr 14 17:14:06 user nova-compute[71689]:   <name>instance-00000016</name>
Apr 14 17:14:06 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:14:06 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:14:06 user nova-compute[71689]:   <metadata>
Apr 14 17:14:06 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:14:06 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:14:06 user nova-compute[71689]:       <nova:name>tempest-TestMinimumBasicScenario-server-1774561863</nova:name>
Apr 14 17:14:06 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:14:05</nova:creationTime>
Apr 14 17:14:06 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:14:06 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:14:06 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:14:06 user nova-compute[71689]:       <nova:owner>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:user uuid="4bd0842f11b0499298e2af46ad659962">tempest-TestMinimumBasicScenario-1645387059-project-member</nova:user>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:project uuid="0a92a4f922f442a88cfb86f8239e52ac">tempest-TestMinimumBasicScenario-1645387059</nova:project>
Apr 14 17:14:06 user nova-compute[71689]:       </nova:owner>
Apr 14 17:14:06 user nova-compute[71689]:       <nova:root type="image" uuid="2575725f-bb4e-408e-8718-10139aaf6e19"/>
Apr 14 17:14:06 user nova-compute[71689]:       <nova:ports>
Apr 14 17:14:06 user nova-compute[71689]:         <nova:port uuid="4295b114-8b6f-42e4-97c3-d6f972188a25">
Apr 14 17:14:06 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 17:14:06 user nova-compute[71689]:         </nova:port>
Apr 14 17:14:06 user nova-compute[71689]:       </nova:ports>
Apr 14 17:14:06 user nova-compute[71689]:     </nova:instance>
Apr 14 17:14:06 user nova-compute[71689]:   </metadata>
Apr 14 17:14:06 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:14:06 user nova-compute[71689]:     <system>
Apr 14 17:14:06 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:14:06 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:14:06 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:14:06 user nova-compute[71689]:       <entry name="serial">35dee18b-ac00-4f46-813e-7a7b400cdba5</entry>
Apr 14 17:14:06 user nova-compute[71689]:       <entry name="uuid">35dee18b-ac00-4f46-813e-7a7b400cdba5</entry>
Apr 14 17:14:06 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:14:06 user nova-compute[71689]:     </system>
Apr 14 17:14:06 user nova-compute[71689]:   </sysinfo>
Apr 14 17:14:06 user nova-compute[71689]:   <os>
Apr 14 17:14:06 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:14:06 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:14:06 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:14:06 user nova-compute[71689]:   </os>
Apr 14 17:14:06 user nova-compute[71689]:   <features>
Apr 14 17:14:06 user nova-compute[71689]:     <acpi/>
Apr 14 17:14:06 user nova-compute[71689]:     <apic/>
Apr 14 17:14:06 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:14:06 user nova-compute[71689]:   </features>
Apr 14 17:14:06 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:14:06 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:14:06 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:14:06 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:14:06 user nova-compute[71689]:   </clock>
Apr 14 17:14:06 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:14:06 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:14:06 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:14:06 user nova-compute[71689]:   </cpu>
Apr 14 17:14:06 user nova-compute[71689]:   <devices>
Apr 14 17:14:06 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:14:06 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:14:06 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk"/>
Apr 14 17:14:06 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:14:06 user nova-compute[71689]:     </disk>
Apr 14 17:14:06 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:14:06 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:14:06 user nova-compute[71689]:       <source dev="/dev/sde"/>
Apr 14 17:14:06 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:14:06 user nova-compute[71689]:       <serial>d702ef9d-11a4-4a6f-81c8-6d132b21f55f</serial>
Apr 14 17:14:06 user nova-compute[71689]:     </disk>
Apr 14 17:14:06 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:14:06 user nova-compute[71689]:       <mac address="fa:16:3e:e3:7a:9b"/>
Apr 14 17:14:06 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:14:06 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:14:06 user nova-compute[71689]:       <target dev="tap4295b114-8b"/>
Apr 14 17:14:06 user nova-compute[71689]:     </interface>
Apr 14 17:14:06 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:14:06 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/console.log" append="off"/>
Apr 14 17:14:06 user nova-compute[71689]:     </serial>
Apr 14 17:14:06 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:14:06 user nova-compute[71689]:     <video>
Apr 14 17:14:06 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:14:06 user nova-compute[71689]:     </video>
Apr 14 17:14:06 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:14:06 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:14:06 user nova-compute[71689]:     </rng>
Apr 14 17:14:06 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:14:06 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:14:06 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:14:06 user nova-compute[71689]:     </memballoon>
Apr 14 17:14:06 user nova-compute[71689]:   </devices>
Apr 14 17:14:06 user nova-compute[71689]: </domain>
Apr 14 17:14:06 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:14:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Cannot resize image /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'migration_context' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1774561863',display_name='tempest-TestMinimumBasicScenario-server-1774561863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1774561863',id=22,image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg==',key_name='tempest-TestMinimumBasicScenario-117998537',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-qq80e7pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:14:04Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=35dee18b-ac00-4f46-813e-7a7b400cdba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG os_vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4295b114-8b, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4295b114-8b, col_values=(('external_ids', {'iface-id': '4295b114-8b6f-42e4-97c3-d6f972188a25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:7a:9b', 'vm-uuid': '35dee18b-ac00-4f46-813e-7a7b400cdba5'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:14:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:07 user nova-compute[71689]: INFO os_vif [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b')
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:10 user nova-compute[71689]: WARNING nova.compute.manager [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 35dee18b-ac00-4f46-813e-7a7b400cdba5 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492451.5508494, 35dee18b-ac00-4f46-813e-7a7b400cdba5 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] VM Resumed (Lifecycle Event)
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:14:11 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance rebooted successfully.
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492451.5532823, 35dee18b-ac00-4f46-813e-7a7b400cdba5 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] VM Started (Lifecycle Event)
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.057s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:12 user nova-compute[71689]: WARNING nova.compute.manager [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state active and task_state None.
Apr 14 17:14:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:14 user nova-compute[71689]: INFO nova.compute.manager [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Detaching volume 37d0e1b4-870e-494c-bc85-ee2c56c4c81f
Apr 14 17:14:14 user nova-compute[71689]: INFO nova.virt.block_device [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Attempting to driver detach volume 37d0e1b4-870e-494c-bc85-ee2c56c4c81f from mountpoint /dev/vdc
Apr 14 17:14:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Attempting to detach device vdc from instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:14:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:14:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:14:14 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:14:14 user nova-compute[71689]:   <target dev="vdc" bus="virtio"/>
Apr 14 17:14:14 user nova-compute[71689]:   <serial>37d0e1b4-870e-494c-bc85-ee2c56c4c81f</serial>
Apr 14 17:14:14 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:14:14 user nova-compute[71689]: </disk>
Apr 14 17:14:14 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:14:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully detached device vdc from instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c from the persistent domain config.
Apr 14 17:14:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:14:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:14:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:14:14 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:14:14 user nova-compute[71689]:   <target dev="vdc" bus="virtio"/>
Apr 14 17:14:14 user nova-compute[71689]:   <serial>37d0e1b4-870e-494c-bc85-ee2c56c4c81f</serial>
Apr 14 17:14:14 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:14:14 user nova-compute[71689]: </disk>
Apr 14 17:14:14 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:14:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492455.0725684, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:14:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully detached device vdc from instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c from the live domain config.
Apr 14 17:14:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XTdjlVrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:14:15 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f9660e-e76c-4b74-92ff-2a187ce90b89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:14:15 user nova-compute[71689]: No targets found.
Apr 14 17:14:15 user nova-compute[71689]: iSNS:
Apr 14 17:14:15 user nova-compute[71689]: No targets found.
Apr 14 17:14:15 user nova-compute[71689]: STATIC:
Apr 14 17:14:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:14:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f
Apr 14 17:14:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:14:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f
Apr 14 17:14:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:14:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:14:15 user nova-compute[71689]: FIRMWARE:
Apr 14 17:14:15 user nova-compute[71689]: No targets found.
Apr 14 17:14:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:14:15 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:14:15 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[038f2eec-5671-46fc-a23b-6f4c083eadd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f319a019-7fb0-48f3-8489-39b2dcf776e5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:15 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:15 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:15 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:14:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:14:15 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:14:15 user nova-compute[71689]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f (non-flash)
Apr 14 17:14:15 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:14:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c0a9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd9a1e6-1b8f-47c8-985a-8eb485678ccf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[add97d76-ad04-4f48-8675-99ab1ee8d067]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1969a709-d3ab-47f6-b828-4f06e8e6c920]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4736a1d-0590-4907-a10e-f678064a8368]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee53aea4-add9-4067-9213-b5cc61a42655]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35cbee8-0392-44b4-9d75-0ea234b9ccdc]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260]
Apr 14 17:14:15 user nova-compute[71689]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f, portal: 172.16.0.220,3260] successful.
Apr 14 17:14:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d0e1b4-870e-494c-bc85-ee2c56c4c81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b157e7f-9779-4577-92ea-db19ef686702]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] <== disconnect_volume: return (335ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:14:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:14:16 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'flavor' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.967s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:14:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [{"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:14:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:26 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:29 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:14:29 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:14:29 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=26.227123260498047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:14:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:14:31 user nova-compute[71689]: INFO nova.compute.manager [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Unrescuing
Apr 14 17:14:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG nova.objects.instance [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'flavor' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:31 user nova-compute[71689]: WARNING nova.compute.manager [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:14:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance destroyed successfully.
Apr 14 17:14:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:33 user nova-compute[71689]: WARNING nova.compute.manager [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:14:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:33 user nova-compute[71689]: WARNING nova.compute.manager [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:14:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 1d1a580c-99da-46df-b02d-e2462d8ef26b due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:14:35 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492475.9851263, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:35 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Resumed (Lifecycle Event)
Apr 14 17:14:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:14:36 user nova-compute[71689]: WARNING nova.compute.manager [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:14:36 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492475.9904282, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:14:36 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Started (Lifecycle Event)
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:14:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:14:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:14:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:14:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:14:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:14:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:14:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:14:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:14:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:15:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:15:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:15:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:15:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:04 user nova-compute[71689]: INFO nova.compute.manager [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Detaching volume 64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:15:04 user nova-compute[71689]: INFO nova.virt.block_device [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attempting to driver detach volume 64feafc1-f567-4496-bde0-d3fa057a7728 from mountpoint /dev/vdb
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Attempting to detach device vdb from instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:15:04 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:04 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:15:04 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:04 user nova-compute[71689]:   <serial>64feafc1-f567-4496-bde0-d3fa057a7728</serial>
Apr 14 17:15:04 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:15:04 user nova-compute[71689]: </disk>
Apr 14 17:15:04 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:15:04 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully detached device vdb from instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 from the persistent domain config.
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:15:04 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:04 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:15:04 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:04 user nova-compute[71689]:   <serial>64feafc1-f567-4496-bde0-d3fa057a7728</serial>
Apr 14 17:15:04 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:15:04 user nova-compute[71689]: </disk>
Apr 14 17:15:04 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492504.6722474, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:15:04 user nova-compute[71689]: INFO nova.compute.manager [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Terminating instance
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:15:04 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully detached device vdb from instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 from the live domain config.
Apr 14 17:15:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQsJhLry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:15:04 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7670e88-4032-42a2-ab0e-ef5de7a65c40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:15:04 user nova-compute[71689]: No targets found.
Apr 14 17:15:04 user nova-compute[71689]: iSNS:
Apr 14 17:15:04 user nova-compute[71689]: No targets found.
Apr 14 17:15:04 user nova-compute[71689]: STATIC:
Apr 14 17:15:04 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728
Apr 14 17:15:04 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:04 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:04 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:15:04 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:04 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:04 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f
Apr 14 17:15:04 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:04 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:04 user nova-compute[71689]: FIRMWARE:
Apr 14 17:15:04 user nova-compute[71689]: No targets found.
Apr 14 17:15:04 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:15:04 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:15:04 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb9ec22-9037-401f-9aa3-55bb7525689f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6d1ed-f62a-43a8-9a94-8876efc2aaef]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:04 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:15:04 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:04 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:04 user nova-compute[71689]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 (non-flash)
Apr 14 17:15:04 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:04 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b3c23f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bab6a9-5b75-4cce-95d0-9e28e82ad86c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2fc0ca-396b-441c-92f6-676a5ff5fb93]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9d7cba-bb34-4ae9-8cef-9b9491cc496b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2d8013-c344-4b93-94e5-dba4b88fe681]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e7386d-4f51-48e8-990c-1c3b436b7325]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:04 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47bbe57-2985-4bb0-92ad-12011939b81a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260]
Apr 14 17:15:05 user nova-compute[71689]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728, portal: 172.16.0.220,3260] successful.
Apr 14 17:15:05 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64feafc1-f567-4496-bde0-d3fa057a7728 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249ecaf-cd2a-46c1-988c-a7f82664a7a0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (340ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-unplugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-unplugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-unplugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:15:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Instance destroyed successfully.
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'resources' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-955558461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-955558461',id=17,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJFC8aHWWcd1B2OKM8xgRJWOuubZu8WyhuvxCCUHyDbwuTPBWSPjT8SoG+9FRiu9oyr4dmhioU2TIDdW0FcVGzCucc3oP1Egh2HH6SxTaumSFKNLHUxywdDbLcwsw7FyA==',key_name='tempest-keypair-2086238855',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:12:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-a0vbjsvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=a0fe02ed-b8cd-43ac-9210-d36e8c90de5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "address": "fa:16:3e:36:f6:67", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf606ba05-7c", "ovs_interfaceid": "f606ba05-7c5e-4e88-94ed-a44a82cb8150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG os_vif [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf606ba05-7c, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:05 user nova-compute[71689]: INFO os_vif [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:67,bridge_name='br-int',has_traffic_filtering=True,id=f606ba05-7c5e-4e88-94ed-a44a82cb8150,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf606ba05-7c')
Apr 14 17:15:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Deleting instance files /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c_del
Apr 14 17:15:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Deletion of /opt/stack/data/nova/instances/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c_del complete
Apr 14 17:15:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:05 user nova-compute[71689]: INFO nova.compute.manager [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'flavor' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:06 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Took 0.89 seconds to deallocate network for instance.
Apr 14 17:15:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:15:06 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:07 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Deleted allocations for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c
Apr 14 17:15:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Acquiring lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Lock "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] No waiting events found dispatching network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:07 user nova-compute[71689]: WARNING nova.compute.manager [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received unexpected event network-vif-plugged-f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance with vm_state deleted and task_state None.
Apr 14 17:15:07 user nova-compute[71689]: DEBUG nova.compute.manager [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Received event network-vif-deleted-f606ba05-7c5e-4e88-94ed-a44a82cb8150 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492505.4428773, a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:15:20 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] VM Stopped (Lifecycle Event)
Apr 14 17:15:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-a891b897-b19a-4f57-8662-204137c049e5 None None] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:15:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:24 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:15:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:15:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:15:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:15:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:15:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=26.246246337890625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:31 user nova-compute[71689]: INFO nova.compute.manager [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Rescuing
Apr 14 17:15:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:15:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG nova.network.neutron [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:32 user nova-compute[71689]: WARNING nova.compute.manager [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state active and task_state rescuing.
Apr 14 17:15:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance destroyed successfully.
Apr 14 17:15:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Attempting rescue
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71689) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:15:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Creating image(s)
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'trusted_certs' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue" returned: 0 in 0.052s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'migration_context' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Start _get_guest_xml network_info=[{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:d0:76:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'resources' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'numa_topology' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:33 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:15:33 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'vcpu_model' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1263709076',display_name='tempest-ServerRescueNegativeTestJSON-server-1263709076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1263709076',id=19,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-aknh1hwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:10:56Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=a075e35f-c43c-4e3a-adb2-2e1629079d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:d0:76:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:d0:76:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'pci_devices' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:15:33 user nova-compute[71689]:   <uuid>a075e35f-c43c-4e3a-adb2-2e1629079d93</uuid>
Apr 14 17:15:33 user nova-compute[71689]:   <name>instance-00000013</name>
Apr 14 17:15:33 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:15:33 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:15:33 user nova-compute[71689]:   <metadata>
Apr 14 17:15:33 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:15:33 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:15:33 user nova-compute[71689]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1263709076</nova:name>
Apr 14 17:15:33 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:15:33</nova:creationTime>
Apr 14 17:15:33 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:15:33 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:15:33 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:15:33 user nova-compute[71689]:       <nova:owner>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:user uuid="2434278fe61447fab1f5a930aa16a1de">tempest-ServerRescueNegativeTestJSON-2056337871-project-member</nova:user>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:project uuid="070c6b9f620548b183904d1971f35752">tempest-ServerRescueNegativeTestJSON-2056337871</nova:project>
Apr 14 17:15:33 user nova-compute[71689]:       </nova:owner>
Apr 14 17:15:33 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:15:33 user nova-compute[71689]:       <nova:ports>
Apr 14 17:15:33 user nova-compute[71689]:         <nova:port uuid="1477a3d2-85fc-4f05-83a0-156f88fc4939">
Apr 14 17:15:33 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:15:33 user nova-compute[71689]:         </nova:port>
Apr 14 17:15:33 user nova-compute[71689]:       </nova:ports>
Apr 14 17:15:33 user nova-compute[71689]:     </nova:instance>
Apr 14 17:15:33 user nova-compute[71689]:   </metadata>
Apr 14 17:15:33 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:15:33 user nova-compute[71689]:     <system>
Apr 14 17:15:33 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:15:33 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:15:33 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:15:33 user nova-compute[71689]:       <entry name="serial">a075e35f-c43c-4e3a-adb2-2e1629079d93</entry>
Apr 14 17:15:33 user nova-compute[71689]:       <entry name="uuid">a075e35f-c43c-4e3a-adb2-2e1629079d93</entry>
Apr 14 17:15:33 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:15:33 user nova-compute[71689]:     </system>
Apr 14 17:15:33 user nova-compute[71689]:   </sysinfo>
Apr 14 17:15:33 user nova-compute[71689]:   <os>
Apr 14 17:15:33 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:15:33 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:15:33 user nova-compute[71689]:   </os>
Apr 14 17:15:33 user nova-compute[71689]:   <features>
Apr 14 17:15:33 user nova-compute[71689]:     <acpi/>
Apr 14 17:15:33 user nova-compute[71689]:     <apic/>
Apr 14 17:15:33 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:15:33 user nova-compute[71689]:   </features>
Apr 14 17:15:33 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:15:33 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:15:33 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:15:33 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:15:33 user nova-compute[71689]:   </clock>
Apr 14 17:15:33 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:15:33 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:15:33 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:15:33 user nova-compute[71689]:   </cpu>
Apr 14 17:15:33 user nova-compute[71689]:   <devices>
Apr 14 17:15:33 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:15:33 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:15:33 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue"/>
Apr 14 17:15:33 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:15:33 user nova-compute[71689]:     </disk>
Apr 14 17:15:33 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:15:33 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:15:33 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk"/>
Apr 14 17:15:33 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:15:33 user nova-compute[71689]:     </disk>
Apr 14 17:15:33 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:15:33 user nova-compute[71689]:       <mac address="fa:16:3e:d0:76:39"/>
Apr 14 17:15:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:15:33 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:15:33 user nova-compute[71689]:       <target dev="tap1477a3d2-85"/>
Apr 14 17:15:33 user nova-compute[71689]:     </interface>
Apr 14 17:15:33 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:15:33 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/console.log" append="off"/>
Apr 14 17:15:33 user nova-compute[71689]:     </serial>
Apr 14 17:15:33 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:15:33 user nova-compute[71689]:     <video>
Apr 14 17:15:33 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:15:33 user nova-compute[71689]:     </video>
Apr 14 17:15:33 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:15:33 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:15:33 user nova-compute[71689]:     </rng>
Apr 14 17:15:33 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:15:33 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:15:33 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:15:33 user nova-compute[71689]:     </memballoon>
Apr 14 17:15:33 user nova-compute[71689]:   </devices>
Apr 14 17:15:33 user nova-compute[71689]: </domain>
Apr 14 17:15:33 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:15:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance destroyed successfully.
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:15:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:d0:76:39, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:34 user nova-compute[71689]: WARNING nova.compute.manager [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state active and task_state rescuing.
Apr 14 17:15:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:36 user nova-compute[71689]: WARNING nova.compute.manager [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state active and task_state rescuing.
Apr 14 17:15:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:36 user nova-compute[71689]: WARNING nova.compute.manager [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state active and task_state rescuing.
Apr 14 17:15:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for a075e35f-c43c-4e3a-adb2-2e1629079d93 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492537.2048297, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:15:37 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Resumed (Lifecycle Event)
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:15:37 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492537.2069361, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:15:37 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Started (Lifecycle Event)
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:15:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:15:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:41 user nova-compute[71689]: INFO nova.compute.manager [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Terminating instance
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-vif-unplugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] No waiting events found dispatching network-vif-unplugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-vif-unplugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:41 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Instance destroyed successfully.
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.objects.instance [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lazy-loading 'resources' on Instance uuid 64126eba-a43a-4dfe-922b-fc89b1fc8d05 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2011999242',display_name='tempest-VolumesActionsTest-instance-2011999242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2011999242',id=23,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65ed93a0cc2a4b2689cd9d26b7f73a14',ramdisk_id='',reservation_id='r-1pdf9awz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-355349757',owner_user_name='tempest-VolumesActionsTest-355349757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:13:57Z,user_data=None,user_id='8312ebadc8bf438dbc01dc42c6257a08',uuid=64126eba-a43a-4dfe-922b-fc89b1fc8d05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converting VIF {"id": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "address": "fa:16:3e:8c:7d:00", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7de6551-76", "ovs_interfaceid": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG os_vif [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7de6551-76, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:15:41 user nova-compute[71689]: INFO os_vif [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7d:00,bridge_name='br-int',has_traffic_filtering=True,id=a7de6551-769f-44f1-8f5f-edc66e5ef5f1,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7de6551-76')
Apr 14 17:15:41 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Deleting instance files /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05_del
Apr 14 17:15:41 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Deletion of /opt/stack/data/nova/instances/64126eba-a43a-4dfe-922b-fc89b1fc8d05_del complete
Apr 14 17:15:42 user nova-compute[71689]: INFO nova.compute.manager [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 17:15:42 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:15:42 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:15:42 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:15:42 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:42 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Took 0.66 seconds to deallocate network for instance.
Apr 14 17:15:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-vif-deleted-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:43 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Deleted allocations for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05
Apr 14 17:15:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received event network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Acquiring lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Lock "64126eba-a43a-4dfe-922b-fc89b1fc8d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] No waiting events found dispatching network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:15:43 user nova-compute[71689]: WARNING nova.compute.manager [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Received unexpected event network-vif-plugged-a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance with vm_state deleted and task_state None.
Apr 14 17:15:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-changed-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Refreshing instance network info cache due to event network-changed-74eca994-ff43-4b06-89f4-fa4bae9c4b90. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:15:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Acquiring lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:15:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Acquired lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:15:46 user nova-compute[71689]: DEBUG nova.network.neutron [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Refreshing network info cache for port 74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:15:47 user nova-compute[71689]: DEBUG nova.network.neutron [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updated VIF entry in instance network info cache for port 74eca994-ff43-4b06-89f4-fa4bae9c4b90. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:15:47 user nova-compute[71689]: DEBUG nova.network.neutron [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updating instance_info_cache with network_info: [{"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Releasing lock "refresh_cache-c85ab15f-39ed-43cc-bbdf-b030dd21d860" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:49 user nova-compute[71689]: INFO nova.compute.manager [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Attaching volume 1a7ea066-31eb-42d2-962a-3cf68651a514 to /dev/vdb
Apr 14 17:15:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG os_brick.utils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[caadf679-79ef-4ed0-b1e5-1c55cb40ac51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c0868-e852-4238-8f49-776af522ca21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[739021df-c017-4027-a719-f54049f3c239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7cb15-257f-4159-aab6-cccd2d8bc69b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:15:49 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:15:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2017d-78f8-42cc-8d07-94781352fdea]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG os_brick.utils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:15:49 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updating existing volume attachment record: babb3c43-2457-4938-bab6-72bbc68f8ed7 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-changed-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Refreshing instance network info cache due to event network-changed-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Acquiring lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Acquired lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Refreshing network info cache for port e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updated VIF entry in instance network info cache for port e9809ce5-c37b-4fdc-9c1b-50e204c9ad37. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updating instance_info_cache with network_info: [{"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Releasing lock "refresh_cache-0d06e72a-65dd-433d-bc13-6550fb85a123" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:15:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:54 user nova-compute[71689]: DEBUG nova.objects.instance [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:55 user nova-compute[71689]: INFO nova.compute.manager [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attaching volume fcff0dc6-88c9-43a8-8210-17d7728d7e56 to /dev/vdb
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.utils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c41f66-02c6-424b-ba6e-c3c95fb84d99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7700e-7e77-4560-b440-676c31174be4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c37ad-0189-4e04-94d1-725be0fb3508]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3165e5-16f0-41f8-99d9-d535a7a93762]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:15:55 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b858a2-6b9b-4d29-9a5e-67dbf1a28e4f]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.utils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updating existing volume attachment record: 29c9af90-aaef-4e6e-b48d-d386979039ac {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing instance network info cache due to event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG nova.network.neutron [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTysYMIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:15:55 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:15:55 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:15:55 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[88289631-a724-4ea2-aeb6-327642bef05d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:15:55 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd3a4ef-1852-43bb-b0fc-e1933eccb293]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514] added
Apr 14 17:15:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0502f045-9026-4536-94f9-dce436319ea3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635c33d-bdc0-4b41-8463-b74d3f26d91a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTysYMIm {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTysYMIm" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a0a1f-7c39-420b-9438-3fea235a1853]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vTysYMIm'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60db3f2-7fe9-4eff-bbf5-ed46a7c18a9e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0d0e46-f2d1-4f08-b901-2a76d526b902]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:55 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:55 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c409091-cbaa-40b2-a1e6-b6733b5fb29d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260]
Apr 14 17:15:55 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260] successful.
Apr 14 17:15:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd2ac47-4944-4be8-85a4-10b9c8419fbc]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2c4eb-2835-4132-a0b6-f0fbf2780e55]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:56 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:56 user nova-compute[71689]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)
Apr 14 17:15:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:56 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:56 user nova-compute[71689]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)
Apr 14 17:15:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7b276-5d57-4c95-8468-4da17b20e57f]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTysYMIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:56 user nova-compute[71689]: INFO nova.compute.manager [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Detaching volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f
Apr 14 17:15:56 user nova-compute[71689]: INFO nova.virt.block_device [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Attempting to driver detach volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f from mountpoint /dev/vdb
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Attempting to detach device vdb from instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:15:56 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:56 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:15:56 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:56 user nova-compute[71689]:   <serial>d702ef9d-11a4-4a6f-81c8-6d132b21f55f</serial>
Apr 14 17:15:56 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:15:56 user nova-compute[71689]: </disk>
Apr 14 17:15:56 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:15:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully detached device vdb from instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 from the persistent domain config.
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:15:56 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:56 user nova-compute[71689]:   <source dev="/dev/sde"/>
Apr 14 17:15:56 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:56 user nova-compute[71689]:   <serial>d702ef9d-11a4-4a6f-81c8-6d132b21f55f</serial>
Apr 14 17:15:56 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 17:15:56 user nova-compute[71689]: </disk>
Apr 14 17:15:56 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.network.neutron [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updated VIF entry in instance network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.network.neutron [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492541.954391, 64126eba-a43a-4dfe-922b-fc89b1fc8d05 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:15:56 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] VM Stopped (Lifecycle Event)
Apr 14 17:15:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-faeef716-c491-45f0-b115-ef89120b69bc None None] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:15:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23738646463663830', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738646463663830', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.objects.instance [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492557.074719, 35dee18b-ac00-4f46-813e-7a7b400cdba5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:15:57 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:57 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:15:57 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:57 user nova-compute[71689]:   <serial>1a7ea066-31eb-42d2-962a-3cf68651a514</serial>
Apr 14 17:15:57 user nova-compute[71689]: </disk>
Apr 14 17:15:57 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:15:57 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully detached device vdb from instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 from the live domain config.
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTNPJMbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:15:57 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dfd16b-82a3-425a-b904-c1708e142c03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:15:57 user nova-compute[71689]: No targets found.
Apr 14 17:15:57 user nova-compute[71689]: iSNS:
Apr 14 17:15:57 user nova-compute[71689]: No targets found.
Apr 14 17:15:57 user nova-compute[71689]: STATIC:
Apr 14 17:15:57 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:15:57 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:57 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:57 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f
Apr 14 17:15:57 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:57 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:57 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514
Apr 14 17:15:57 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:57 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:57 user nova-compute[71689]: FIRMWARE:
Apr 14 17:15:57 user nova-compute[71689]: No targets found.
Apr 14 17:15:57 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:15:57 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:15:57 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a485d43-1a48-4db9-b482-6590d1610481]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[90951d67-621c-4b87-ad1a-b2710e008d47]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:57 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:57 user nova-compute[71689]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)
Apr 14 17:15:57 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:57 user nova-compute[71689]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f (non-flash)
Apr 14 17:15:57 user nova-compute[71689]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)
Apr 14 17:15:57 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b560a35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[863011e2-9408-4c09-a05d-bdb5f5952b8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b90f3aa-5333-4b86-8e59-ac2f509c9493]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a912016e-e47a-427a-8fd6-655d54a1e4fc]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeed536-9857-4263-8ae8-1b938487c939]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48374ae-121b-4593-825f-f65d15ca6359]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0e1b53-cc71-40a8-95f8-227058e098b8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260]
Apr 14 17:15:57 user nova-compute[71689]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f, portal: 172.16.0.220,3260] successful.
Apr 14 17:15:57 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d702ef9d-11a4-4a6f-81c8-6d132b21f55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff44cf-7d4b-4bb2-b981-9ae09d9d8cb0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== disconnect_volume: return (332ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] No VIF found with MAC fa:16:3e:53:b0:45, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing instance network info cache due to event network-changed-4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Acquiring lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Acquired lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG nova.network.neutron [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Refreshing network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:15:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.881s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG nova.network.neutron [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updated VIF entry in instance network info cache for port 4295b114-8b6f-42e4-97c3-d6f972188a25. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG nova.network.neutron [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [{"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Releasing lock "refresh_cache-35dee18b-ac00-4f46-813e-7a7b400cdba5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:58 user nova-compute[71689]: INFO nova.compute.manager [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Detaching volume 1a7ea066-31eb-42d2-962a-3cf68651a514
Apr 14 17:15:58 user nova-compute[71689]: INFO nova.virt.block_device [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Attempting to driver detach volume 1a7ea066-31eb-42d2-962a-3cf68651a514 from mountpoint /dev/vdb
Apr 14 17:15:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Attempting to detach device vdb from instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:15:58 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:58 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:15:58 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:58 user nova-compute[71689]:   <serial>1a7ea066-31eb-42d2-962a-3cf68651a514</serial>
Apr 14 17:15:58 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:15:58 user nova-compute[71689]: </disk>
Apr 14 17:15:58 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:15:58 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully detached device vdb from instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 from the persistent domain config.
Apr 14 17:15:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:15:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:15:58 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:15:58 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:15:58 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:15:58 user nova-compute[71689]:   <serial>1a7ea066-31eb-42d2-962a-3cf68651a514</serial>
Apr 14 17:15:58 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:15:58 user nova-compute[71689]: </disk>
Apr 14 17:15:58 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492559.257771, c85ab15f-39ed-43cc-bbdf-b030dd21d860 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:15:59 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully detached device vdb from instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 from the live domain config.
Apr 14 17:15:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTysYMIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:15:59 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7144c0-a7ea-4c8f-bb4d-d376564ea7ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:15:59 user nova-compute[71689]: No targets found.
Apr 14 17:15:59 user nova-compute[71689]: iSNS:
Apr 14 17:15:59 user nova-compute[71689]: No targets found.
Apr 14 17:15:59 user nova-compute[71689]: STATIC:
Apr 14 17:15:59 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:15:59 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:59 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:59 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514
Apr 14 17:15:59 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:15:59 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:15:59 user nova-compute[71689]: FIRMWARE:
Apr 14 17:15:59 user nova-compute[71689]: No targets found.
Apr 14 17:15:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:15:59 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:15:59 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7c83d-f393-4363-a345-38b29f03fd2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[384244e5-7555-47b1-a19a-e361d6e16906]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:59 user nova-compute[71689]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)
Apr 14 17:15:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:15:59 user nova-compute[71689]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 (non-flash)
Apr 14 17:15:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c0aa5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[66803f09-a0a6-4410-b3ed-683301a0d824]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bcb1b9-51b0-436c-b821-83dee343f37c]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0aa1bf-ccdd-4d89-b189-83fe87de77bc]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5267c4a5-5a7a-440f-afd3-cadc0d30b893]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3032b7e-16c7-468e-b96f-0a9ceaa7346a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad532487-2c96-49b5-acb4-636fcc847604]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260]
Apr 14 17:15:59 user nova-compute[71689]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514, portal: 172.16.0.220,3260] successful.
Apr 14 17:15:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a7ea066-31eb-42d2-962a-3cf68651a514 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[24132eb6-6477-4017-a919-2e94987dab5d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] <== disconnect_volume: return (280ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:15:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:15:59 user nova-compute[71689]: INFO nova.compute.claims [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Claim successful on node user
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:16:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'flavor' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.793s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.policy [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:16:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Creating image(s)
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.127s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'flavor' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk 1073741824" returned: 0 in 0.050s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.435s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:00 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZYTaDjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:16:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:16:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:16:01 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a15fe-8002-4bb5-83b4-d3c28d61f99f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:16:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704c85a-a0f2-4003-a931-4e0a5a3d3a5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56] added
Apr 14 17:16:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Cannot resize image /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.objects.instance [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'migration_context' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c3f82-caac-45ba-b9ca-6f9361b35940]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Ensure instance console log exists: /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c337f35-5db3-4db3-9c85-aeebdbe13d4b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZYTaDjL {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZYTaDjL" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[de563737-07bd-4bbf-b10f-f6b4dd5d457a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZYTaDjL'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daf0bb2-bd07-494b-a2cb-24f01485a301]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[783dde09-7562-4115-b4be-5103e949e984]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f03f12-9aab-4c6e-af8a-600d14c7ca38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260]
Apr 14 17:16:01 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260] successful.
Apr 14 17:16:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e45f07-16b5-494f-9fb8-8080d6c05a1f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d41d5d-386b-4dab-9be7-8e6589400f12]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:01 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:01 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e281b6-367e-4696-84c2-74ba73727f65]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Successfully created port: fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:16:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Successfully updated port: fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-changed-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing instance network info cache due to event network-changed-fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZYTaDjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23962303937333966', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962303937333966', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:16:02 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:16:02 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:16:02 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:16:02 user nova-compute[71689]:   <serial>fcff0dc6-88c9-43a8-8210-17d7728d7e56</serial>
Apr 14 17:16:02 user nova-compute[71689]: </disk>
Apr 14 17:16:02 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance network_info: |[{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing network info cache for port fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Start _get_guest_xml network_info=[{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:16:02 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:02 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1087117818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1087117818',id=26,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmu0k6XkCj93lDjab3hWIuIddTxIIe6New3tssd+lQXrZvNkzrJwGACl6up5dJSwaMP2JphmLRtB0WeXyM7HltVl/Wuya2YOuiNr8wsIufy9MKTweL9xsZymU8LiqDqeA==',key_name='tempest-keypair-2079826628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-3v6vpup2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=49931fa3-281e-43d0-a3e9-fde8f502b2cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'pci_devices' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:16:02 user nova-compute[71689]:   <uuid>49931fa3-281e-43d0-a3e9-fde8f502b2cd</uuid>
Apr 14 17:16:02 user nova-compute[71689]:   <name>instance-0000001a</name>
Apr 14 17:16:02 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:16:02 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:16:02 user nova-compute[71689]:   <metadata>
Apr 14 17:16:02 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:16:02 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:16:02 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1087117818</nova:name>
Apr 14 17:16:02 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:16:02</nova:creationTime>
Apr 14 17:16:02 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:16:02 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:16:02 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:16:02 user nova-compute[71689]:       <nova:owner>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:user uuid="6aa926d6cfc94b08a564404f95da5483">tempest-AttachVolumeShelveTestJSON-339689049-project-member</nova:user>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:project uuid="1ae1b41823a64cd0b1c1a1669ad202ec">tempest-AttachVolumeShelveTestJSON-339689049</nova:project>
Apr 14 17:16:02 user nova-compute[71689]:       </nova:owner>
Apr 14 17:16:02 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:16:02 user nova-compute[71689]:       <nova:ports>
Apr 14 17:16:02 user nova-compute[71689]:         <nova:port uuid="fd88804d-f436-4656-89b3-22638cb26897">
Apr 14 17:16:02 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:16:02 user nova-compute[71689]:         </nova:port>
Apr 14 17:16:02 user nova-compute[71689]:       </nova:ports>
Apr 14 17:16:02 user nova-compute[71689]:     </nova:instance>
Apr 14 17:16:02 user nova-compute[71689]:   </metadata>
Apr 14 17:16:02 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:16:02 user nova-compute[71689]:     <system>
Apr 14 17:16:02 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:16:02 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:16:02 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:16:02 user nova-compute[71689]:       <entry name="serial">49931fa3-281e-43d0-a3e9-fde8f502b2cd</entry>
Apr 14 17:16:02 user nova-compute[71689]:       <entry name="uuid">49931fa3-281e-43d0-a3e9-fde8f502b2cd</entry>
Apr 14 17:16:02 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:16:02 user nova-compute[71689]:     </system>
Apr 14 17:16:02 user nova-compute[71689]:   </sysinfo>
Apr 14 17:16:02 user nova-compute[71689]:   <os>
Apr 14 17:16:02 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:16:02 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:16:02 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:16:02 user nova-compute[71689]:   </os>
Apr 14 17:16:02 user nova-compute[71689]:   <features>
Apr 14 17:16:02 user nova-compute[71689]:     <acpi/>
Apr 14 17:16:02 user nova-compute[71689]:     <apic/>
Apr 14 17:16:02 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:16:02 user nova-compute[71689]:   </features>
Apr 14 17:16:02 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:16:02 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:16:02 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:16:02 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:16:02 user nova-compute[71689]:   </clock>
Apr 14 17:16:02 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:16:02 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:16:02 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:16:02 user nova-compute[71689]:   </cpu>
Apr 14 17:16:02 user nova-compute[71689]:   <devices>
Apr 14 17:16:02 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:16:02 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:16:02 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk"/>
Apr 14 17:16:02 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:16:02 user nova-compute[71689]:     </disk>
Apr 14 17:16:02 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:16:02 user nova-compute[71689]:       <mac address="fa:16:3e:99:49:0f"/>
Apr 14 17:16:02 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:16:02 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:16:02 user nova-compute[71689]:       <target dev="tapfd88804d-f4"/>
Apr 14 17:16:02 user nova-compute[71689]:     </interface>
Apr 14 17:16:02 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:16:02 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/console.log" append="off"/>
Apr 14 17:16:02 user nova-compute[71689]:     </serial>
Apr 14 17:16:02 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:16:02 user nova-compute[71689]:     <video>
Apr 14 17:16:02 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:16:02 user nova-compute[71689]:     </video>
Apr 14 17:16:02 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:16:02 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:16:02 user nova-compute[71689]:     </rng>
Apr 14 17:16:02 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:16:02 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:16:02 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:16:02 user nova-compute[71689]:     </memballoon>
Apr 14 17:16:02 user nova-compute[71689]:   </devices>
Apr 14 17:16:02 user nova-compute[71689]: </domain>
Apr 14 17:16:02 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1087117818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1087117818',id=26,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmu0k6XkCj93lDjab3hWIuIddTxIIe6New3tssd+lQXrZvNkzrJwGACl6up5dJSwaMP2JphmLRtB0WeXyM7HltVl/Wuya2YOuiNr8wsIufy9MKTweL9xsZymU8LiqDqeA==',key_name='tempest-keypair-2079826628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-3v6vpup2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=49931fa3-281e-43d0-a3e9-fde8f502b2cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG os_vif [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd88804d-f4, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd88804d-f4, col_values=(('external_ids', {'iface-id': 'fd88804d-f436-4656-89b3-22638cb26897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:49:0f', 'vm-uuid': '49931fa3-281e-43d0-a3e9-fde8f502b2cd'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:02 user nova-compute[71689]: INFO os_vif [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4')
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No VIF found with MAC fa:16:3e:99:49:0f, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No VIF found with MAC fa:16:3e:d5:bf:0c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updated VIF entry in instance network info cache for port fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.997s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:04 user nova-compute[71689]: WARNING nova.compute.manager [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state building and task_state spawning.
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492566.189577, 49931fa3-281e-43d0-a3e9-fde8f502b2cd => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] VM Resumed (Lifecycle Event)
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance spawned successfully.
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492566.1923954, 49931fa3-281e-43d0-a3e9-fde8f502b2cd => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] VM Started (Lifecycle Event)
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Took 5.76 seconds to spawn the instance on the hypervisor.
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:06 user nova-compute[71689]: WARNING nova.compute.manager [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state building and task_state spawning.
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Took 6.48 seconds to build instance.
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.583s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.objects.instance [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:06 user nova-compute[71689]: INFO nova.compute.manager [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attaching volume ea4a9d9c-d192-4146-9acf-97ece8fb9139 to /dev/vdc
Apr 14 17:16:06 user nova-compute[71689]: DEBUG os_brick.utils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28328a1a-486e-4a16-8599-45cece0b4997]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283d8fa-dec7-4cf6-9b77-b755249fe03c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac11915-da55-4a1a-9a61-908d3ef54928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9235cb-a64e-42ee-a5ff-77a72063bffe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:16:06 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:16:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd25a9b-5907-4c48-a040-b2827ff402b2]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG os_brick.utils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:16:06 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updating existing volume attachment record: e9ac331b-8a16-4cdb-96ff-053ca237ae76 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:16:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymPGRVkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:16:11 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:16:11 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:16:11 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f4257-cf40-4f4e-bd57-5f0c9c717fe5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:16:11 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ae7a4c-f265-4c2f-a606-11a1b05e9d36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139] added
Apr 14 17:16:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7454d6f-736f-4f17-978a-e21b9c61ba7e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a06b64-5207-4db0-a08a-9be5bd09d784]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymPGRVkC {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymPGRVkC" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ff868-0e30-4093-a0a8-ef1957dc868d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ymPGRVkC'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e4dd5-7748-49f8-9778-f4df4f69a216]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4f0df3-fba3-4e2d-b745-5ab0b7ad2bde]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b73c5-d973-47ad-a1f2-6da871618921]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260]
Apr 14 17:16:11 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260] successful.
Apr 14 17:16:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f21a66-2e6b-4099-ae6d-6baf7c27fb47]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbfe8c1-87d5-4dc4-8905-31c27357cb73]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)
Apr 14 17:16:11 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7396f4a-4772-4bfa-a147-88f4fd69b07d]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:16:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymPGRVkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:16:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:16:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23366336137346332', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:16:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366336137346332', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:16:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:16:12 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:16:12 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:16:12 user nova-compute[71689]:   <target dev="vdc" bus="virtio"/>
Apr 14 17:16:12 user nova-compute[71689]:   <serial>ea4a9d9c-d192-4146-9acf-97ece8fb9139</serial>
Apr 14 17:16:12 user nova-compute[71689]: </disk>
Apr 14 17:16:12 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:16:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] No VIF found with MAC fa:16:3e:d5:bf:0c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:16:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.736s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:14 user nova-compute[71689]: INFO nova.compute.manager [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Detaching volume fcff0dc6-88c9-43a8-8210-17d7728d7e56
Apr 14 17:16:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:14 user nova-compute[71689]: INFO nova.virt.block_device [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attempting to driver detach volume fcff0dc6-88c9-43a8-8210-17d7728d7e56 from mountpoint /dev/vdb
Apr 14 17:16:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Attempting to detach device vdb from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:16:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:16:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:16:14 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:16:14 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:16:14 user nova-compute[71689]:   <serial>fcff0dc6-88c9-43a8-8210-17d7728d7e56</serial>
Apr 14 17:16:14 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:16:14 user nova-compute[71689]: </disk>
Apr 14 17:16:14 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:16:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully detached device vdb from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the persistent domain config.
Apr 14 17:16:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:16:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:16:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:16:14 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:16:14 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:16:14 user nova-compute[71689]:   <serial>fcff0dc6-88c9-43a8-8210-17d7728d7e56</serial>
Apr 14 17:16:14 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:16:14 user nova-compute[71689]: </disk>
Apr 14 17:16:14 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492575.404639, 0d06e72a-65dd-433d-bc13-6550fb85a123 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:16:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully detached device vdb from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the live domain config.
Apr 14 17:16:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZYTaDjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:16:15 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ada1d-83c8-4600-986b-d8dedbd6f856]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:16:15 user nova-compute[71689]: No targets found.
Apr 14 17:16:15 user nova-compute[71689]: iSNS:
Apr 14 17:16:15 user nova-compute[71689]: No targets found.
Apr 14 17:16:15 user nova-compute[71689]: STATIC:
Apr 14 17:16:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56
Apr 14 17:16:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:16:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:16:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:16:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:16:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:16:15 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139
Apr 14 17:16:15 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:16:15 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:16:15 user nova-compute[71689]: FIRMWARE:
Apr 14 17:16:15 user nova-compute[71689]: No targets found.
Apr 14 17:16:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:16:15 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:16:15 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1298a11b-b414-42b4-ae5d-889c41e90c0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a77ca-70a3-4aa3-8420-2774d5d1ca0a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:15 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:15 user nova-compute[71689]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)
Apr 14 17:16:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:15 user nova-compute[71689]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 (non-flash)
Apr 14 17:16:15 user nova-compute[71689]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)
Apr 14 17:16:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b3c1fd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2976d-8307-46a9-8220-807bf12d4e0f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb36d2-a56d-4de9-9087-2550f7d9ef12]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e79a38-0ddd-4db7-9cb2-15213a3b20da]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af7f89e-d261-4149-a0e9-aa29e62ff80e]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae1f0a-0a67-4cf6-947c-a7e7d8a81a97]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581e25c-5f0c-4be8-80a0-ffdd5273f15a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260]
Apr 14 17:16:15 user nova-compute[71689]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56, portal: 172.16.0.220,3260] successful.
Apr 14 17:16:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcff0dc6-88c9-43a8-8210-17d7728d7e56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c501162-0136-4ff1-8252-e7c0a2b0d04f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== disconnect_volume: return (311ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:16:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:16:16 user nova-compute[71689]: DEBUG nova.objects.instance [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.857s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:17 user nova-compute[71689]: INFO nova.compute.manager [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Detaching volume ea4a9d9c-d192-4146-9acf-97ece8fb9139
Apr 14 17:16:17 user nova-compute[71689]: INFO nova.virt.block_device [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Attempting to driver detach volume ea4a9d9c-d192-4146-9acf-97ece8fb9139 from mountpoint /dev/vdc
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Attempting to detach device vdc from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:16:17 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:16:17 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:16:17 user nova-compute[71689]:   <target dev="vdc" bus="virtio"/>
Apr 14 17:16:17 user nova-compute[71689]:   <serial>ea4a9d9c-d192-4146-9acf-97ece8fb9139</serial>
Apr 14 17:16:17 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 17:16:17 user nova-compute[71689]: </disk>
Apr 14 17:16:17 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:16:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully detached device vdc from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the persistent domain config.
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:16:17 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:16:17 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:16:17 user nova-compute[71689]:   <target dev="vdc" bus="virtio"/>
Apr 14 17:16:17 user nova-compute[71689]:   <serial>ea4a9d9c-d192-4146-9acf-97ece8fb9139</serial>
Apr 14 17:16:17 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 17:16:17 user nova-compute[71689]: </disk>
Apr 14 17:16:17 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492577.8086407, 0d06e72a-65dd-433d-bc13-6550fb85a123 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:16:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully detached device vdc from instance 0d06e72a-65dd-433d-bc13-6550fb85a123 from the live domain config.
Apr 14 17:16:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymPGRVkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:16:17 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125f17c-c50b-46a8-8379-a0a892639260]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:16:17 user nova-compute[71689]: No targets found.
Apr 14 17:16:17 user nova-compute[71689]: iSNS:
Apr 14 17:16:17 user nova-compute[71689]: No targets found.
Apr 14 17:16:17 user nova-compute[71689]: STATIC:
Apr 14 17:16:17 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:16:17 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:16:17 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:16:17 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139
Apr 14 17:16:17 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:16:17 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:16:17 user nova-compute[71689]: FIRMWARE:
Apr 14 17:16:17 user nova-compute[71689]: No targets found.
Apr 14 17:16:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:16:17 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:16:17 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ded1470-15fd-4397-888a-b0661c2a971f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe0fadb-1c4d-4041-87eb-20cc019ddb12]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:17 user nova-compute[71689]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)
Apr 14 17:16:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:16:17 user nova-compute[71689]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 (non-flash)
Apr 14 17:16:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b3c28b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd0660e-f0c0-41bb-b221-60ed45a81fd7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a79147-fea7-46d6-b160-66a5518142cf]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b56c75-2eb5-4490-8af0-5cdc9874ef26]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:16:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafcc846-f360-4901-b919-c9996604e2b9]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2e6b7f-dda0-4ca1-bedc-8ad22404280e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e3e47-be0a-494e-a5da-a4d1379f992f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260]
Apr 14 17:16:18 user nova-compute[71689]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139, portal: 172.16.0.220,3260] successful.
Apr 14 17:16:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4a9d9c-d192-4146-9acf-97ece8fb9139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fe7c76-e27e-4ea2-b8f5-0a2ec6249eaa]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] <== disconnect_volume: return (298ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:16:18 user nova-compute[71689]: DEBUG nova.objects.instance [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'flavor' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:19 user nova-compute[71689]: INFO nova.compute.manager [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Terminating instance
Apr 14 17:16:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-vif-unplugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] No waiting events found dispatching network-vif-unplugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-vif-unplugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:16:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Instance destroyed successfully.
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'resources' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1995210077',display_name='tempest-AttachVolumeTestJSON-server-1995210077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1995210077',id=25,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0uW0bfc2VtorRe+2+EDqsDVec89xkRAc5iKeALuOkKQ8tOYj6wSac/VyJ2lUwhS8eUsyWL9lTocWKwpfOk7Q4YvVGlOSCvR4MzeuEWa3Q8l7EFB4rmzP5clCT67VI6jQ==',key_name='tempest-keypair-1936947036',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c8f6b39515e456c9f5a1affa9f79000',ramdisk_id='',reservation_id='r-20cbmd6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-917907278',owner_user_name='tempest-AttachVolumeTestJSON-917907278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7c4734925f645248b0f9060aa78a502',uuid=0d06e72a-65dd-433d-bc13-6550fb85a123,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converting VIF {"id": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "address": "fa:16:3e:d5:bf:0c", "network": {"id": "ae8c914e-554e-4cdf-b176-7ede005eb4f6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-994820033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c8f6b39515e456c9f5a1affa9f79000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9809ce5-c3", "ovs_interfaceid": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG os_vif [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9809ce5-c3, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:16:20 user nova-compute[71689]: INFO os_vif [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:bf:0c,bridge_name='br-int',has_traffic_filtering=True,id=e9809ce5-c37b-4fdc-9c1b-50e204c9ad37,network=Network(ae8c914e-554e-4cdf-b176-7ede005eb4f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9809ce5-c3')
Apr 14 17:16:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Deleting instance files /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123_del
Apr 14 17:16:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Deletion of /opt/stack/data/nova/instances/0d06e72a-65dd-433d-bc13-6550fb85a123_del complete
Apr 14 17:16:20 user nova-compute[71689]: INFO nova.compute.manager [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 17:16:20 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:16:20 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:16:21 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:21 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Took 0.92 seconds to deallocate network for instance.
Apr 14 17:16:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-vif-deleted-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:22 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Deleted allocations for instance 0d06e72a-65dd-433d-bc13-6550fb85a123
Apr 14 17:16:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received event network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Acquiring lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] No waiting events found dispatching network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:22 user nova-compute[71689]: WARNING nova.compute.manager [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Received unexpected event network-vif-plugged-e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance with vm_state deleted and task_state None.
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "0d06e72a-65dd-433d-bc13-6550fb85a123" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.503s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:16:23 user nova-compute[71689]: INFO nova.compute.claims [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Claim successful on node user
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:16:23 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.policy [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:16:23 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Creating image(s)
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk 1073741824" returned: 0 in 0.049s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:23 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Successfully created port: 26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Cannot resize image /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'migration_context' on Instance uuid a3e1f09c-567e-41d1-9c35-58b8371a1d1c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Ensure instance console log exists: /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Successfully updated port: 26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-a3e1f09c-567e-41d1-9c35-58b8371a1d1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-a3e1f09c-567e-41d1-9c35-58b8371a1d1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-changed-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Refreshing instance network info cache due to event network-changed-26192624-8026-443e-8abd-c2890d04fd77. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Acquiring lock "refresh_cache-a3e1f09c-567e-41d1-9c35-58b8371a1d1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Updating instance_info_cache with network_info: [{"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-a3e1f09c-567e-41d1-9c35-58b8371a1d1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Instance network_info: |[{"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Acquired lock "refresh_cache-a3e1f09c-567e-41d1-9c35-58b8371a1d1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.neutron [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Refreshing network info cache for port 26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Start _get_guest_xml network_info=[{"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:16:25 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:25 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-119717964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-119717964',id=27,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-beyddcwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:16:24Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=a3e1f09c-567e-41d1-9c35-58b8371a1d1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'pci_devices' on Instance uuid a3e1f09c-567e-41d1-9c35-58b8371a1d1c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:16:25 user nova-compute[71689]:   <uuid>a3e1f09c-567e-41d1-9c35-58b8371a1d1c</uuid>
Apr 14 17:16:25 user nova-compute[71689]:   <name>instance-0000001b</name>
Apr 14 17:16:25 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:16:25 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:16:25 user nova-compute[71689]:   <metadata>
Apr 14 17:16:25 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:16:25 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:16:25 user nova-compute[71689]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-119717964</nova:name>
Apr 14 17:16:25 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:16:25</nova:creationTime>
Apr 14 17:16:25 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:16:25 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:16:25 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:16:25 user nova-compute[71689]:       <nova:owner>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:user uuid="b5c86125160643958349100fb3a7855b">tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member</nova:user>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:project uuid="965bd22f61df40bd89e8ef35fb12bcd3">tempest-ServerBootFromVolumeStableRescueTest-995212803</nova:project>
Apr 14 17:16:25 user nova-compute[71689]:       </nova:owner>
Apr 14 17:16:25 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:16:25 user nova-compute[71689]:       <nova:ports>
Apr 14 17:16:25 user nova-compute[71689]:         <nova:port uuid="26192624-8026-443e-8abd-c2890d04fd77">
Apr 14 17:16:25 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 17:16:25 user nova-compute[71689]:         </nova:port>
Apr 14 17:16:25 user nova-compute[71689]:       </nova:ports>
Apr 14 17:16:25 user nova-compute[71689]:     </nova:instance>
Apr 14 17:16:25 user nova-compute[71689]:   </metadata>
Apr 14 17:16:25 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:16:25 user nova-compute[71689]:     <system>
Apr 14 17:16:25 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:16:25 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:16:25 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:16:25 user nova-compute[71689]:       <entry name="serial">a3e1f09c-567e-41d1-9c35-58b8371a1d1c</entry>
Apr 14 17:16:25 user nova-compute[71689]:       <entry name="uuid">a3e1f09c-567e-41d1-9c35-58b8371a1d1c</entry>
Apr 14 17:16:25 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:16:25 user nova-compute[71689]:     </system>
Apr 14 17:16:25 user nova-compute[71689]:   </sysinfo>
Apr 14 17:16:25 user nova-compute[71689]:   <os>
Apr 14 17:16:25 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:16:25 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:16:25 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:16:25 user nova-compute[71689]:   </os>
Apr 14 17:16:25 user nova-compute[71689]:   <features>
Apr 14 17:16:25 user nova-compute[71689]:     <acpi/>
Apr 14 17:16:25 user nova-compute[71689]:     <apic/>
Apr 14 17:16:25 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:16:25 user nova-compute[71689]:   </features>
Apr 14 17:16:25 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:16:25 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:16:25 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:16:25 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:16:25 user nova-compute[71689]:   </clock>
Apr 14 17:16:25 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:16:25 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:16:25 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:16:25 user nova-compute[71689]:   </cpu>
Apr 14 17:16:25 user nova-compute[71689]:   <devices>
Apr 14 17:16:25 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:16:25 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:16:25 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk"/>
Apr 14 17:16:25 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:16:25 user nova-compute[71689]:     </disk>
Apr 14 17:16:25 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:16:25 user nova-compute[71689]:       <mac address="fa:16:3e:ba:6b:ed"/>
Apr 14 17:16:25 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:16:25 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:16:25 user nova-compute[71689]:       <target dev="tap26192624-80"/>
Apr 14 17:16:25 user nova-compute[71689]:     </interface>
Apr 14 17:16:25 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:16:25 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/console.log" append="off"/>
Apr 14 17:16:25 user nova-compute[71689]:     </serial>
Apr 14 17:16:25 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:16:25 user nova-compute[71689]:     <video>
Apr 14 17:16:25 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:16:25 user nova-compute[71689]:     </video>
Apr 14 17:16:25 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:16:25 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:16:25 user nova-compute[71689]:     </rng>
Apr 14 17:16:25 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:16:25 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:16:25 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:16:25 user nova-compute[71689]:     </memballoon>
Apr 14 17:16:25 user nova-compute[71689]:   </devices>
Apr 14 17:16:25 user nova-compute[71689]: </domain>
Apr 14 17:16:25 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-119717964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-119717964',id=27,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-beyddcwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:16:24Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=a3e1f09c-567e-41d1-9c35-58b8371a1d1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG os_vif [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26192624-80, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26192624-80, col_values=(('external_ids', {'iface-id': '26192624-8026-443e-8abd-c2890d04fd77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:6b:ed', 'vm-uuid': 'a3e1f09c-567e-41d1-9c35-58b8371a1d1c'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:25 user nova-compute[71689]: INFO os_vif [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80')
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No VIF found with MAC fa:16:3e:ba:6b:ed, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Skipping network cache update for instance because it is Building. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Updated VIF entry in instance network info cache for port 26192624-8026-443e-8abd-c2890d04fd77. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Updating instance_info_cache with network_info: [{"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Releasing lock "refresh_cache-a3e1f09c-567e-41d1-9c35-58b8371a1d1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updating instance_info_cache with network_info: [{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] No waiting events found dispatching network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:27 user nova-compute[71689]: WARNING nova.compute.manager [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received unexpected event network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 for instance with vm_state building and task_state spawning.
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492589.4221113, a3e1f09c-567e-41d1-9c35-58b8371a1d1c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] VM Resumed (Lifecycle Event)
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Instance spawned successfully.
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] No waiting events found dispatching network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:29 user nova-compute[71689]: WARNING nova.compute.manager [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received unexpected event network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 for instance with vm_state building and task_state spawning.
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492589.4343102, a3e1f09c-567e-41d1-9c35-58b8371a1d1c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] VM Started (Lifecycle Event)
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 14 17:16:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:29 user nova-compute[71689]: INFO nova.compute.manager [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Took 6.71 seconds to build instance.
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.815s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=26.232357025146484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:16:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:16:33 user nova-compute[71689]: INFO nova.compute.claims [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Claim successful on node user
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:16:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.policy [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:16:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Creating image(s)
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "/opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "/opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.126s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk 1073741824" returned: 0 in 0.088s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Successfully created port: 130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Cannot resize image /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lazy-loading 'migration_context' on Instance uuid d5dd90e8-4232-4f87-ac96-a5a142e3370c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Ensure instance console log exists: /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Successfully updated port: 130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "refresh_cache-d5dd90e8-4232-4f87-ac96-a5a142e3370c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquired lock "refresh_cache-d5dd90e8-4232-4f87-ac96-a5a142e3370c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-changed-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Refreshing instance network info cache due to event network-changed-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Acquiring lock "refresh_cache-d5dd90e8-4232-4f87-ac96-a5a142e3370c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Updating instance_info_cache with network_info: [{"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492580.5994644, 0d06e72a-65dd-433d-bc13-6550fb85a123 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:35 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] VM Stopped (Lifecycle Event)
Apr 14 17:16:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Releasing lock "refresh_cache-d5dd90e8-4232-4f87-ac96-a5a142e3370c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Instance network_info: |[{"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Acquired lock "refresh_cache-d5dd90e8-4232-4f87-ac96-a5a142e3370c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.neutron [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Refreshing network info cache for port 130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Start _get_guest_xml network_info=[{"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8a53e736-71de-435e-9ccc-858d8fa6eea5 None None] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-510926440',display_name='tempest-VolumesActionsTest-instance-510926440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-510926440',id=28,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ed93a0cc2a4b2689cd9d26b7f73a14',ramdisk_id='',reservation_id='r-p0qr8fx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-355349757',owner_user_name='tempest-VolumesActionsTest-355349757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:16:34Z,user_data=None,user_id='8312ebadc8bf438dbc01dc42c6257a08',uuid=d5dd90e8-4232-4f87-ac96-a5a142e3370c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converting VIF {"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lazy-loading 'pci_devices' on Instance uuid d5dd90e8-4232-4f87-ac96-a5a142e3370c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:16:35 user nova-compute[71689]:   <uuid>d5dd90e8-4232-4f87-ac96-a5a142e3370c</uuid>
Apr 14 17:16:35 user nova-compute[71689]:   <name>instance-0000001c</name>
Apr 14 17:16:35 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:16:35 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:16:35 user nova-compute[71689]:   <metadata>
Apr 14 17:16:35 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:16:35 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:16:35 user nova-compute[71689]:       <nova:name>tempest-VolumesActionsTest-instance-510926440</nova:name>
Apr 14 17:16:35 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:16:35</nova:creationTime>
Apr 14 17:16:35 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:16:35 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:16:35 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:16:35 user nova-compute[71689]:       <nova:owner>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:user uuid="8312ebadc8bf438dbc01dc42c6257a08">tempest-VolumesActionsTest-355349757-project-member</nova:user>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:project uuid="65ed93a0cc2a4b2689cd9d26b7f73a14">tempest-VolumesActionsTest-355349757</nova:project>
Apr 14 17:16:35 user nova-compute[71689]:       </nova:owner>
Apr 14 17:16:35 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:16:35 user nova-compute[71689]:       <nova:ports>
Apr 14 17:16:35 user nova-compute[71689]:         <nova:port uuid="130d0e48-7ee6-4fe7-9a2d-7ef5042e966b">
Apr 14 17:16:35 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 17:16:35 user nova-compute[71689]:         </nova:port>
Apr 14 17:16:35 user nova-compute[71689]:       </nova:ports>
Apr 14 17:16:35 user nova-compute[71689]:     </nova:instance>
Apr 14 17:16:35 user nova-compute[71689]:   </metadata>
Apr 14 17:16:35 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:16:35 user nova-compute[71689]:     <system>
Apr 14 17:16:35 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:16:35 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:16:35 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:16:35 user nova-compute[71689]:       <entry name="serial">d5dd90e8-4232-4f87-ac96-a5a142e3370c</entry>
Apr 14 17:16:35 user nova-compute[71689]:       <entry name="uuid">d5dd90e8-4232-4f87-ac96-a5a142e3370c</entry>
Apr 14 17:16:35 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:16:35 user nova-compute[71689]:     </system>
Apr 14 17:16:35 user nova-compute[71689]:   </sysinfo>
Apr 14 17:16:35 user nova-compute[71689]:   <os>
Apr 14 17:16:35 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:16:35 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:16:35 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:16:35 user nova-compute[71689]:   </os>
Apr 14 17:16:35 user nova-compute[71689]:   <features>
Apr 14 17:16:35 user nova-compute[71689]:     <acpi/>
Apr 14 17:16:35 user nova-compute[71689]:     <apic/>
Apr 14 17:16:35 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:16:35 user nova-compute[71689]:   </features>
Apr 14 17:16:35 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:16:35 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:16:35 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:16:35 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:16:35 user nova-compute[71689]:   </clock>
Apr 14 17:16:35 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:16:35 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:16:35 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:16:35 user nova-compute[71689]:   </cpu>
Apr 14 17:16:35 user nova-compute[71689]:   <devices>
Apr 14 17:16:35 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:16:35 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:16:35 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk"/>
Apr 14 17:16:35 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:16:35 user nova-compute[71689]:     </disk>
Apr 14 17:16:35 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:16:35 user nova-compute[71689]:       <mac address="fa:16:3e:7d:97:b3"/>
Apr 14 17:16:35 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:16:35 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:16:35 user nova-compute[71689]:       <target dev="tap130d0e48-7e"/>
Apr 14 17:16:35 user nova-compute[71689]:     </interface>
Apr 14 17:16:35 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:16:35 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/console.log" append="off"/>
Apr 14 17:16:35 user nova-compute[71689]:     </serial>
Apr 14 17:16:35 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:16:35 user nova-compute[71689]:     <video>
Apr 14 17:16:35 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:16:35 user nova-compute[71689]:     </video>
Apr 14 17:16:35 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:16:35 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:16:35 user nova-compute[71689]:     </rng>
Apr 14 17:16:35 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:16:35 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:16:35 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:16:35 user nova-compute[71689]:     </memballoon>
Apr 14 17:16:35 user nova-compute[71689]:   </devices>
Apr 14 17:16:35 user nova-compute[71689]: </domain>
Apr 14 17:16:35 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-510926440',display_name='tempest-VolumesActionsTest-instance-510926440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-510926440',id=28,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ed93a0cc2a4b2689cd9d26b7f73a14',ramdisk_id='',reservation_id='r-p0qr8fx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-355349757',owner_user_name='tempest-VolumesActionsTest-355349757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:16:34Z,user_data=None,user_id='8312ebadc8bf438dbc01dc42c6257a08',uuid=d5dd90e8-4232-4f87-ac96-a5a142e3370c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converting VIF {"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG os_vif [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap130d0e48-7e, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap130d0e48-7e, col_values=(('external_ids', {'iface-id': '130d0e48-7ee6-4fe7-9a2d-7ef5042e966b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:97:b3', 'vm-uuid': 'd5dd90e8-4232-4f87-ac96-a5a142e3370c'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:35 user nova-compute[71689]: INFO os_vif [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e')
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:16:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] No VIF found with MAC fa:16:3e:7d:97:b3, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:16:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Updated VIF entry in instance network info cache for port 130d0e48-7ee6-4fe7-9a2d-7ef5042e966b. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:16:36 user nova-compute[71689]: DEBUG nova.network.neutron [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Updating instance_info_cache with network_info: [{"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Releasing lock "refresh_cache-d5dd90e8-4232-4f87-ac96-a5a142e3370c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:37 user nova-compute[71689]: WARNING nova.compute.manager [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state building and task_state spawning.
Apr 14 17:16:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492599.5174983, d5dd90e8-4232-4f87-ac96-a5a142e3370c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] VM Resumed (Lifecycle Event)
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Instance spawned successfully.
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492599.5190208, d5dd90e8-4232-4f87-ac96-a5a142e3370c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] VM Started (Lifecycle Event)
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:39 user nova-compute[71689]: WARNING nova.compute.manager [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state building and task_state spawning.
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Took 5.94 seconds to spawn the instance on the hypervisor.
Apr 14 17:16:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:16:39 user nova-compute[71689]: INFO nova.compute.manager [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Took 6.68 seconds to build instance.
Apr 14 17:16:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.778s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:49 user nova-compute[71689]: INFO nova.compute.manager [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Terminating instance
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-unplugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-unplugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-unplugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Instance destroyed successfully.
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'resources' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824688479',display_name='tempest-AttachVolumeNegativeTest-server-1824688479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1824688479',id=24,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiAzZy9dK3YblixiueVEZjNo3Yf/Mse2QN0h6OPOOvKGQHCpmIShPfBNrSnB3HhcPcnWcV0+yoNiILxw9YMH9tL3wdLVIiHbJ+m1obAVawIKBAO8XvsM6rixZ+hO9LV7A==',key_name='tempest-keypair-154124342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f341a2096b9483787b569a59f325556',ramdisk_id='',reservation_id='r-5ewcnkkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1177875221',owner_user_name='tempest-AttachVolumeNegativeTest-1177875221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c9e0d318eb4ca49d47d620682fb00a',uuid=c85ab15f-39ed-43cc-bbdf-b030dd21d860,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converting VIF {"id": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "address": "fa:16:3e:53:b0:45", "network": {"id": "06f3eb05-9ead-4131-b955-af3bc09e9758", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1619949423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f341a2096b9483787b569a59f325556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74eca994-ff", "ovs_interfaceid": "74eca994-ff43-4b06-89f4-fa4bae9c4b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG os_vif [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74eca994-ff, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:16:49 user nova-compute[71689]: INFO os_vif [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:45,bridge_name='br-int',has_traffic_filtering=True,id=74eca994-ff43-4b06-89f4-fa4bae9c4b90,network=Network(06f3eb05-9ead-4131-b955-af3bc09e9758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74eca994-ff')
Apr 14 17:16:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Deleting instance files /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860_del
Apr 14 17:16:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Deletion of /opt/stack/data/nova/instances/c85ab15f-39ed-43cc-bbdf-b030dd21d860_del complete
Apr 14 17:16:49 user nova-compute[71689]: INFO nova.compute.manager [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 17:16:49 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:16:49 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:50 user nova-compute[71689]: INFO nova.compute.manager [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Terminating instance
Apr 14 17:16:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-unplugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-unplugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-unplugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-deleted-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.compute.manager [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Neutron deleted interface 74eca994-ff43-4b06-89f4-fa4bae9c4b90; detaching it from the instance and deleting it from the info cache
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Took 1.10 seconds to deallocate network for instance.
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Instance destroyed successfully.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'resources' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Detach interface failed, port_id=74eca994-ff43-4b06-89f4-fa4bae9c4b90, reason: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1774561863',display_name='tempest-TestMinimumBasicScenario-server-1774561863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1774561863',id=22,image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg==',key_name='tempest-TestMinimumBasicScenario-117998537',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-qq80e7pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2575725f-bb4e-408e-8718-10139aaf6e19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:14:12Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=35dee18b-ac00-4f46-813e-7a7b400cdba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "4295b114-8b6f-42e4-97c3-d6f972188a25", "address": "fa:16:3e:e3:7a:9b", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4295b114-8b", "ovs_interfaceid": "4295b114-8b6f-42e4-97c3-d6f972188a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG os_vif [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4295b114-8b, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:16:51 user nova-compute[71689]: INFO os_vif [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7a:9b,bridge_name='br-int',has_traffic_filtering=True,id=4295b114-8b6f-42e4-97c3-d6f972188a25,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4295b114-8b')
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Deleting instance files /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5_del
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Deletion of /opt/stack/data/nova/instances/35dee18b-ac00-4f46-813e-7a7b400cdba5_del complete
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.compute.manager [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:51 user nova-compute[71689]: WARNING nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state deleted and task_state None.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:51 user nova-compute[71689]: WARNING nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state deleted and task_state None.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:51 user nova-compute[71689]: WARNING nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state deleted and task_state None.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-unplugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-unplugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:51 user nova-compute[71689]: WARNING nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-unplugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state deleted and task_state None.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Acquiring lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] No waiting events found dispatching network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:51 user nova-compute[71689]: WARNING nova.compute.manager [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Received unexpected event network-vif-plugged-74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance with vm_state deleted and task_state None.
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:51 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Deleted allocations for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860
Apr 14 17:16:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "c85ab15f-39ed-43cc-bbdf-b030dd21d860" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.637s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:16:52 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Took 0.85 seconds to deallocate network for instance.
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:52 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Deleted allocations for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Acquiring lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Lock "35dee18b-ac00-4f46-813e-7a7b400cdba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] No waiting events found dispatching network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:16:52 user nova-compute[71689]: WARNING nova.compute.manager [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received unexpected event network-vif-plugged-4295b114-8b6f-42e4-97c3-d6f972188a25 for instance with vm_state deleted and task_state None.
Apr 14 17:16:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Received event network-vif-deleted-4295b114-8b6f-42e4-97c3-d6f972188a25 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:16:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG nova.objects.instance [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'flavor' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:16:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attaching volume dc2e1bba-01b7-42d9-8760-d569da7c4fae to /dev/vdb
Apr 14 17:16:58 user nova-compute[71689]: DEBUG os_brick.utils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cac115-f42d-445f-a22c-b4e96952b273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0270a16-7f0d-483b-aefb-7d584a010eda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[532cd153-96db-4686-9481-5b750d2a5204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1221c739-1a3c-494a-8102-e1a5bd3eb886]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:16:58 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:16:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7037ed01-0e3a-40ea-b02a-b1d1e46d8d3c]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG os_brick.utils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:16:58 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating existing volume attachment record: 4fb7c18f-1fd8-4bb5-a181-e5abf61862d9 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:16:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:17:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:17:02 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:17:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:17:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:17:02 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:17:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:17:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:17:02 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:17:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6a4bd-2ea8-4e2d-8fe0-8264374791aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:17:03 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9870e1c0-3a3e-4a4e-990c-ff84ab7df413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae] added
Apr 14 17:17:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccfa43f-c285-4131-ae4b-c295fc62c9cf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3967e6f-9fd0-401f-90ce-b89ed259671a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwaTsbyx {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwaTsbyx" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[065fff7e-87ef-4783-bca5-4052c4b2a444]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BwaTsbyx'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[10305f4d-eb79-4807-bf68-53bf8272c8a5]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ab1bf-7747-4172-a374-0ec81e818d49]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d07343-750c-441d-8c6b-46ec1c7e4cb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]
Apr 14 17:17:03 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.
Apr 14 17:17:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b341e50f-d068-42a0-842d-160c35d9d54a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfce20f-af65-4f1b-8133-75ce850e0a79]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:03 user nova-compute[71689]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:17:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:03 user nova-compute[71689]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:17:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[92440f85-edc6-4349-b11e-1e4c69fcd567]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:17:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23364646136353839', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364646136353839', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.objects.instance [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'flavor' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:17:04 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:17:04 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:17:04 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:17:04 user nova-compute[71689]:   <serial>dc2e1bba-01b7-42d9-8760-d569da7c4fae</serial>
Apr 14 17:17:04 user nova-compute[71689]: </disk>
Apr 14 17:17:04 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:0a:01:98, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492609.825982, c85ab15f-39ed-43cc-bbdf-b030dd21d860 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:04 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] VM Stopped (Lifecycle Event)
Apr 14 17:17:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d2616159-e840-44d6-9d4c-1a9c478f27be None None] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.536s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:06 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492611.1055937, 35dee18b-ac00-4f46-813e-7a7b400cdba5 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:06 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] VM Stopped (Lifecycle Event)
Apr 14 17:17:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5f324bc7-a67f-4473-ba99-ad9a4edc8582 None None] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Stashing vm_state: active {{(pid=71689) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_requests' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:17:07 user nova-compute[71689]: INFO nova.compute.claims [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Claim successful on node user
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.objects.instance [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_devices' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:07 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating resource usage from migration 7a4ecf85-1bc8-445d-969a-3fde978d6390
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.440s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:07 user nova-compute[71689]: INFO nova.compute.manager [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Migrating
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:07 user nova-compute[71689]: INFO nova.compute.rpcapi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:07 user nova-compute[71689]: DEBUG nova.network.neutron [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG nova.network.neutron [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Starting migrate_disk_and_power_off {{(pid=71689) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:08 user nova-compute[71689]: WARNING nova.compute.manager [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state resize_migrating.
Apr 14 17:17:09 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance destroyed successfully.
Apr 14 17:17:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde268504-35, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:17:09 user nova-compute[71689]: INFO os_vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:17:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:17:09 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b8ab5d-1990-4eda-a663-3fdbd15e97f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:17:09 user nova-compute[71689]: No targets found.
Apr 14 17:17:09 user nova-compute[71689]: iSNS:
Apr 14 17:17:09 user nova-compute[71689]: No targets found.
Apr 14 17:17:09 user nova-compute[71689]: STATIC:
Apr 14 17:17:09 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae
Apr 14 17:17:09 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:17:09 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:17:09 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:17:09 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:17:09 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:17:09 user nova-compute[71689]: FIRMWARE:
Apr 14 17:17:09 user nova-compute[71689]: No targets found.
Apr 14 17:17:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:17:09 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:17:09 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1641701-337f-4166-89cb-9d9e54666210]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d09a29c-0b44-4d4b-b0dd-9ee804c8aa8d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:09 user nova-compute[71689]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:17:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:09 user nova-compute[71689]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:17:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c1f7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[534a0e16-02bc-4dbd-9f3e-9ecca42addae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e58cd-a571-452e-ba13-12e2f7e845c1]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7ae1f-8c13-40ab-9e76-37f1744d77cf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c9a32-0bb1-468b-8592-52ff1340f44a]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8bc806-5a61-425e-b0ee-d4a7dda4ef56]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3a1e8-b9bf-4d94-b03a-8e6232e3d864]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]
Apr 14 17:17:09 user nova-compute[71689]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.
Apr 14 17:17:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b8375-a93b-40d4-86a0-e77980355fc0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (278ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_resize/disk /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "cp -r /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_resize/disk /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk" returned: 0 in 0.250s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_resize/disk.info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "cp -r /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_resize/disk.info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk.info" returned: 0 in 0.031s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:10 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:10 user nova-compute[71689]: WARNING nova.compute.manager [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state resize_migrating.
Apr 14 17:17:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Port de268504-352a-4d08-8113-a2098b794478 binding to destination host user is already ACTIVE {{(pid=71689) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG os_brick.utils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[905fac86-6358-4def-9c7a-f8241ce4d93d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff8b01-d8b6-4f7c-a9da-9acc32e22ab2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e8a96-902d-48fb-be5d-4b37e2001d62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bda6d1-f26b-4cbf-a8ad-83a6bbac28b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:17:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:17:12 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:17:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af8101-98a3-4a1a-beab-135a3852c888]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:17:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:17:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:17:12 user nova-compute[71689]: DEBUG os_brick.utils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:17:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Starting finish_migration {{(pid=71689) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:17:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Creating image(s)
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.objects.instance [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Cannot resize image /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Ensure instance console log exists: /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start _get_guest_xml network_info=[{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84c02556-abf7-4832-a1b2-a2c28a7f8e52', 'attached_at': '2023-04-14T17:17:17.000000', 'detached_at': '', 'volume_id': 'dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'serial': 'dc2e1bba-01b7-42d9-8760-d569da7c4fae'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '73da378a-5204-4216-bd27-8d78d6f9b4bb', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:17:16 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:17:16 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.objects.instance [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:17:17 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:17:17 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:17:17 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e78ada-c6c7-4e8f-88e4-f26a8605d2ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:17:17 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de68ad4-4035-4414-bffb-e98670fb3105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae] added
Apr 14 17:17:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[54675938-c680-4d5a-8bf5-48d28699f7a6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f6e588-3ce6-4906-bd50-ab9cd56110cd]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwaTsbyx {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwaTsbyx" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff9eb7-5d15-4e32-8005-727a66826839]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BwaTsbyx'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c682af9-ca3d-4972-898d-d3a2ed4bfd83]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4619d7b-f3a0-4e0c-b218-6e4e9be2eaf8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80114fb-6639-49a4-a064-8db80d3e8f96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]
Apr 14 17:17:17 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.
Apr 14 17:17:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ad20e-98ab-401f-9391-59de290eb9f1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[13efd109-60f1-4f54-b037-f5725f1213e1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:17 user nova-compute[71689]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:17:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:17:17 user nova-compute[71689]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:17:17 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7be563f-7f51-41ba-b781-a74083bb4841]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:17:17 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23364646136353839', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364646136353839', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:17:18 user nova-compute[71689]:   <uuid>84c02556-abf7-4832-a1b2-a2c28a7f8e52</uuid>
Apr 14 17:17:18 user nova-compute[71689]:   <name>instance-00000010</name>
Apr 14 17:17:18 user nova-compute[71689]:   <memory>196608</memory>
Apr 14 17:17:18 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:17:18 user nova-compute[71689]:   <metadata>
Apr 14 17:17:18 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:17:18 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:17:18 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-595094216</nova:name>
Apr 14 17:17:18 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:17:16</nova:creationTime>
Apr 14 17:17:18 user nova-compute[71689]:       <nova:flavor name="m1.micro">
Apr 14 17:17:18 user nova-compute[71689]:         <nova:memory>192</nova:memory>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:17:18 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:17:18 user nova-compute[71689]:       <nova:owner>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:17:18 user nova-compute[71689]:       </nova:owner>
Apr 14 17:17:18 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:17:18 user nova-compute[71689]:       <nova:ports>
Apr 14 17:17:18 user nova-compute[71689]:         <nova:port uuid="de268504-352a-4d08-8113-a2098b794478">
Apr 14 17:17:18 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:17:18 user nova-compute[71689]:         </nova:port>
Apr 14 17:17:18 user nova-compute[71689]:       </nova:ports>
Apr 14 17:17:18 user nova-compute[71689]:     </nova:instance>
Apr 14 17:17:18 user nova-compute[71689]:   </metadata>
Apr 14 17:17:18 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:17:18 user nova-compute[71689]:     <system>
Apr 14 17:17:18 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:17:18 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:17:18 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:17:18 user nova-compute[71689]:       <entry name="serial">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:17:18 user nova-compute[71689]:       <entry name="uuid">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:17:18 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:17:18 user nova-compute[71689]:     </system>
Apr 14 17:17:18 user nova-compute[71689]:   </sysinfo>
Apr 14 17:17:18 user nova-compute[71689]:   <os>
Apr 14 17:17:18 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:17:18 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:17:18 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:17:18 user nova-compute[71689]:   </os>
Apr 14 17:17:18 user nova-compute[71689]:   <features>
Apr 14 17:17:18 user nova-compute[71689]:     <acpi/>
Apr 14 17:17:18 user nova-compute[71689]:     <apic/>
Apr 14 17:17:18 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:17:18 user nova-compute[71689]:   </features>
Apr 14 17:17:18 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:17:18 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:17:18 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:17:18 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:17:18 user nova-compute[71689]:   </clock>
Apr 14 17:17:18 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:17:18 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:17:18 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:17:18 user nova-compute[71689]:   </cpu>
Apr 14 17:17:18 user nova-compute[71689]:   <devices>
Apr 14 17:17:18 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:17:18 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:17:18 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk"/>
Apr 14 17:17:18 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:17:18 user nova-compute[71689]:     </disk>
Apr 14 17:17:18 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:17:18 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:17:18 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:17:18 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:17:18 user nova-compute[71689]:       <serial>dc2e1bba-01b7-42d9-8760-d569da7c4fae</serial>
Apr 14 17:17:18 user nova-compute[71689]:     </disk>
Apr 14 17:17:18 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:17:18 user nova-compute[71689]:       <mac address="fa:16:3e:0a:01:98"/>
Apr 14 17:17:18 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:17:18 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:17:18 user nova-compute[71689]:       <target dev="tapde268504-35"/>
Apr 14 17:17:18 user nova-compute[71689]:     </interface>
Apr 14 17:17:18 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:17:18 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log" append="off"/>
Apr 14 17:17:18 user nova-compute[71689]:     </serial>
Apr 14 17:17:18 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:17:18 user nova-compute[71689]:     <video>
Apr 14 17:17:18 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:17:18 user nova-compute[71689]:     </video>
Apr 14 17:17:18 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:17:18 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:17:18 user nova-compute[71689]:     </rng>
Apr 14 17:17:18 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:17:18 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:17:18 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:17:18 user nova-compute[71689]:     </memballoon>
Apr 14 17:17:18 user nova-compute[71689]:   </devices>
Apr 14 17:17:18 user nova-compute[71689]: </domain>
Apr 14 17:17:18 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:0a:01:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG os_vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde268504-35, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde268504-35, col_values=(('external_ids', {'iface-id': 'de268504-352a-4d08-8113-a2098b794478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:01:98', 'vm-uuid': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:18 user nova-compute[71689]: INFO os_vif [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:17:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:0a:01:98, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:17:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:20 user nova-compute[71689]: WARNING nova.compute.manager [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state resize_finish.
Apr 14 17:17:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 84c02556-abf7-4832-a1b2-a2c28a7f8e52 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492642.11811, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Resumed (Lifecycle Event)
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:17:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance running successfully.
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Failed to set time: agent not configured {{(pid=71689) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] finish_migration finished successfully. {{(pid=71689) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:17:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492642.1199613, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Started (Lifecycle Event)
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:22 user nova-compute[71689]: WARNING nova.compute.manager [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state active and task_state resize_finish.
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:17:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 17:17:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:23 user nova-compute[71689]: INFO nova.compute.manager [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Unrescuing
Apr 14 17:17:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:24 user nova-compute[71689]: WARNING nova.compute.manager [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:17:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:25 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance destroyed successfully.
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:26 user nova-compute[71689]: WARNING nova.compute.manager [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:17:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:17:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for a075e35f-c43c-4e3a-adb2-2e1629079d93 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492648.654177, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:28 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Resumed (Lifecycle Event)
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:17:28 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492648.6547728, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:28 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Started (Lifecycle Event)
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:29 user nova-compute[71689]: WARNING nova.compute.manager [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state active and task_state None.
Apr 14 17:17:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:29 user nova-compute[71689]: WARNING nova.compute.manager [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state active and task_state None.
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:17:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=26.20126724243164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Applying migration context for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 as it has an incoming, in-progress migration 7a4ecf85-1bc8-445d-969a-3fde978d6390. Migration status is finished {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 17:17:31 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating resource usage from migration 7a4ecf85-1bc8-445d-969a-3fde978d6390
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Migration 7a4ecf85-1bc8-445d-969a-3fde978d6390 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:17:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:32 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:32 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:17:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:17:44 user nova-compute[71689]: INFO nova.compute.claims [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Claim successful on node user
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:17:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:17:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Creating image(s)
Apr 14 17:17:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "/opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "/opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "53548ab6a50f1e8258800bc75b560b86d05bf2ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "53548ab6a50f1e8258800bc75b560b86d05bf2ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:45 user nova-compute[71689]: DEBUG nova.policy [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG nova.virt.images [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 8caa5797-8d3f-4f61-87c7-49659946e637 was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.part /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.part /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.converted" returned: 0 in 0.224s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Successfully created port: 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "53548ab6a50f1e8258800bc75b560b86d05bf2ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.088s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "53548ab6a50f1e8258800bc75b560b86d05bf2ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "53548ab6a50f1e8258800bc75b560b86d05bf2ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef,backing_fmt=raw /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef,backing_fmt=raw /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk 1073741824" returned: 0 in 0.051s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "53548ab6a50f1e8258800bc75b560b86d05bf2ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Cannot resize image /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.objects.instance [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'migration_context' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Successfully updated port: 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Ensure instance console log exists: /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing instance network info cache due to event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance network_info: |[{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.neutron [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Start _get_guest_xml network_info=[{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T17:17:42Z,direct_url=<?>,disk_format='qcow2',id=8caa5797-8d3f-4f61-87c7-49659946e637,min_disk=0,min_ram=0,name='tempest-scenario-img--1118396701',owner='0a92a4f922f442a88cfb86f8239e52ac',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T17:17:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': '8caa5797-8d3f-4f61-87c7-49659946e637'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:17:47 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:17:47 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T17:17:42Z,direct_url=<?>,disk_format='qcow2',id=8caa5797-8d3f-4f61-87c7-49659946e637,min_disk=0,min_ram=0,name='tempest-scenario-img--1118396701',owner='0a92a4f922f442a88cfb86f8239e52ac',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T17:17:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1126441201',display_name='tempest-TestMinimumBasicScenario-server-1126441201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1126441201',id=29,image_ref='8caa5797-8d3f-4f61-87c7-49659946e637',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBqCKExFDT4PvSC0/Uu1Any81coLdKotsFBCAghCyw66XGwNtKRqgQhOViH0z9vGTd8aHqH3bIsE+BRrOoCbXTCLZj1BZ5obFRwyyFzyqkP9hL4qq9+vfqA17m0cuNySw==',key_name='tempest-TestMinimumBasicScenario-1307984235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-a75c24e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8caa5797-8d3f-4f61-87c7-49659946e637',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:17:45Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=6a5ebe0f-81d3-4dbc-b55f-4c42d2857715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.objects.instance [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:17:47 user nova-compute[71689]:   <uuid>6a5ebe0f-81d3-4dbc-b55f-4c42d2857715</uuid>
Apr 14 17:17:47 user nova-compute[71689]:   <name>instance-0000001d</name>
Apr 14 17:17:47 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:17:47 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:17:47 user nova-compute[71689]:   <metadata>
Apr 14 17:17:47 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:17:47 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:17:47 user nova-compute[71689]:       <nova:name>tempest-TestMinimumBasicScenario-server-1126441201</nova:name>
Apr 14 17:17:47 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:17:47</nova:creationTime>
Apr 14 17:17:47 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:17:47 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:17:47 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:17:47 user nova-compute[71689]:       <nova:owner>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:user uuid="4bd0842f11b0499298e2af46ad659962">tempest-TestMinimumBasicScenario-1645387059-project-member</nova:user>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:project uuid="0a92a4f922f442a88cfb86f8239e52ac">tempest-TestMinimumBasicScenario-1645387059</nova:project>
Apr 14 17:17:47 user nova-compute[71689]:       </nova:owner>
Apr 14 17:17:47 user nova-compute[71689]:       <nova:root type="image" uuid="8caa5797-8d3f-4f61-87c7-49659946e637"/>
Apr 14 17:17:47 user nova-compute[71689]:       <nova:ports>
Apr 14 17:17:47 user nova-compute[71689]:         <nova:port uuid="43e76338-e6dd-456e-b1e2-d2f7c150f14d">
Apr 14 17:17:47 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:17:47 user nova-compute[71689]:         </nova:port>
Apr 14 17:17:47 user nova-compute[71689]:       </nova:ports>
Apr 14 17:17:47 user nova-compute[71689]:     </nova:instance>
Apr 14 17:17:47 user nova-compute[71689]:   </metadata>
Apr 14 17:17:47 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:17:47 user nova-compute[71689]:     <system>
Apr 14 17:17:47 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:17:47 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:17:47 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:17:47 user nova-compute[71689]:       <entry name="serial">6a5ebe0f-81d3-4dbc-b55f-4c42d2857715</entry>
Apr 14 17:17:47 user nova-compute[71689]:       <entry name="uuid">6a5ebe0f-81d3-4dbc-b55f-4c42d2857715</entry>
Apr 14 17:17:47 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:17:47 user nova-compute[71689]:     </system>
Apr 14 17:17:47 user nova-compute[71689]:   </sysinfo>
Apr 14 17:17:47 user nova-compute[71689]:   <os>
Apr 14 17:17:47 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:17:47 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:17:47 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:17:47 user nova-compute[71689]:   </os>
Apr 14 17:17:47 user nova-compute[71689]:   <features>
Apr 14 17:17:47 user nova-compute[71689]:     <acpi/>
Apr 14 17:17:47 user nova-compute[71689]:     <apic/>
Apr 14 17:17:47 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:17:47 user nova-compute[71689]:   </features>
Apr 14 17:17:47 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:17:47 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:17:47 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:17:47 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:17:47 user nova-compute[71689]:   </clock>
Apr 14 17:17:47 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:17:47 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:17:47 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:17:47 user nova-compute[71689]:   </cpu>
Apr 14 17:17:47 user nova-compute[71689]:   <devices>
Apr 14 17:17:47 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:17:47 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:17:47 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk"/>
Apr 14 17:17:47 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:17:47 user nova-compute[71689]:     </disk>
Apr 14 17:17:47 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:17:47 user nova-compute[71689]:       <mac address="fa:16:3e:14:65:80"/>
Apr 14 17:17:47 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:17:47 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:17:47 user nova-compute[71689]:       <target dev="tap43e76338-e6"/>
Apr 14 17:17:47 user nova-compute[71689]:     </interface>
Apr 14 17:17:47 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:17:47 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/console.log" append="off"/>
Apr 14 17:17:47 user nova-compute[71689]:     </serial>
Apr 14 17:17:47 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:17:47 user nova-compute[71689]:     <video>
Apr 14 17:17:47 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:17:47 user nova-compute[71689]:     </video>
Apr 14 17:17:47 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:17:47 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:17:47 user nova-compute[71689]:     </rng>
Apr 14 17:17:47 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:17:47 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:17:47 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:17:47 user nova-compute[71689]:     </memballoon>
Apr 14 17:17:47 user nova-compute[71689]:   </devices>
Apr 14 17:17:47 user nova-compute[71689]: </domain>
Apr 14 17:17:47 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1126441201',display_name='tempest-TestMinimumBasicScenario-server-1126441201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1126441201',id=29,image_ref='8caa5797-8d3f-4f61-87c7-49659946e637',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBqCKExFDT4PvSC0/Uu1Any81coLdKotsFBCAghCyw66XGwNtKRqgQhOViH0z9vGTd8aHqH3bIsE+BRrOoCbXTCLZj1BZ5obFRwyyFzyqkP9hL4qq9+vfqA17m0cuNySw==',key_name='tempest-TestMinimumBasicScenario-1307984235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-a75c24e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8caa5797-8d3f-4f61-87c7-49659946e637',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:17:45Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=6a5ebe0f-81d3-4dbc-b55f-4c42d2857715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG os_vif [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43e76338-e6, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43e76338-e6, col_values=(('external_ids', {'iface-id': '43e76338-e6dd-456e-b1e2-d2f7c150f14d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:65:80', 'vm-uuid': '6a5ebe0f-81d3-4dbc-b55f-4c42d2857715'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:17:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:47 user nova-compute[71689]: INFO os_vif [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6')
Apr 14 17:17:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:17:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No VIF found with MAC fa:16:3e:14:65:80, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:17:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updated VIF entry in instance network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:17:48 user nova-compute[71689]: DEBUG nova.network.neutron [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:49 user nova-compute[71689]: WARNING nova.compute.manager [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state building and task_state spawning.
Apr 14 17:17:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492671.6996539, 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] VM Resumed (Lifecycle Event)
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance spawned successfully.
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:51 user nova-compute[71689]: WARNING nova.compute.manager [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state building and task_state spawning.
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-changed-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing instance network info cache due to event network-changed-fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing network info cache for port fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492671.6999319, 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] VM Started (Lifecycle Event)
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Took 6.33 seconds to spawn the instance on the hypervisor.
Apr 14 17:17:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:51 user nova-compute[71689]: INFO nova.compute.manager [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Took 7.08 seconds to build instance.
Apr 14 17:17:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.197s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:52 user nova-compute[71689]: DEBUG nova.network.neutron [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updated VIF entry in instance network info cache for port fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:17:52 user nova-compute[71689]: DEBUG nova.network.neutron [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.005s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:54 user nova-compute[71689]: INFO nova.compute.manager [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Shelving
Apr 14 17:17:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-unplugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-unplugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:55 user nova-compute[71689]: WARNING nova.compute.manager [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-unplugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state active and task_state shelving.
Apr 14 17:17:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance destroyed successfully.
Apr 14 17:17:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Beginning cold snapshot process
Apr 14 17:17:55 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:17:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk /opt/stack/data/nova/instances/snapshots/tmpd7iwvkuf/afcdb9ab7cbf4e87820253d151367ee0 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:17:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk /opt/stack/data/nova/instances/snapshots/tmpd7iwvkuf/afcdb9ab7cbf4e87820253d151367ee0" returned: 0 in 0.436s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:17:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Snapshot extracted, beginning image upload
Apr 14 17:17:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:17:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:17:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:17:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:17:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:17:57 user nova-compute[71689]: WARNING nova.compute.manager [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 17:17:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:17:58 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Snapshot image upload complete
Apr 14 17:17:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:58 user nova-compute[71689]: INFO nova.compute.manager [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Shelve offloading
Apr 14 17:17:58 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance destroyed successfully.
Apr 14 17:17:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:17:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:17:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:17:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:17:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:17:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:17:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance destroyed successfully.
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'resources' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1087117818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1087117818',id=26,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmu0k6XkCj93lDjab3hWIuIddTxIIe6New3tssd+lQXrZvNkzrJwGACl6up5dJSwaMP2JphmLRtB0WeXyM7HltVl/Wuya2YOuiNr8wsIufy9MKTweL9xsZymU8LiqDqeA==',key_name='tempest-keypair-2079826628',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-3v6vpup2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member',shelved_at='2023-04-14T17:17:58.560163',shelved_host='user',shelved_image_id='b3a0d8d4-3bee-4204-9b1b-d85af551cb7e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=49931fa3-281e-43d0-a3e9-fde8f502b2cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG os_vif [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd88804d-f4, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-changed-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing instance network info cache due to event network-changed-fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.network.neutron [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing network info cache for port fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:18:00 user nova-compute[71689]: INFO os_vif [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4')
Apr 14 17:18:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Deleting instance files /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd_del
Apr 14 17:18:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Deletion of /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd_del complete
Apr 14 17:18:00 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Deleted allocations for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd
Apr 14 17:18:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'numa_topology' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:18:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:01 user nova-compute[71689]: DEBUG nova.network.neutron [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updated VIF entry in instance network info cache for port fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:18:01 user nova-compute[71689]: DEBUG nova.network.neutron [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfd88804d-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:18:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.123s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:18:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:10 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492675.5321634, 49931fa3-281e-43d0-a3e9-fde8f502b2cd => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:18:10 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] VM Stopped (Lifecycle Event)
Apr 14 17:18:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d8d0912f-7a2e-458e-aff6-539a67adab64 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:18:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:18:14 user nova-compute[71689]: INFO nova.compute.manager [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] instance snapshotting
Apr 14 17:18:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Beginning live snapshot process
Apr 14 17:18:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7gq427ov/772abd017f9241aca3510139b90c9370.delta 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7gq427ov/772abd017f9241aca3510139b90c9370.delta 1073741824" returned: 0 in 0.058s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 17:18:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:18:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:18:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 17:18:16 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:18:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7gq427ov/772abd017f9241aca3510139b90c9370.delta /opt/stack/data/nova/instances/snapshots/tmp7gq427ov/772abd017f9241aca3510139b90c9370 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7gq427ov/772abd017f9241aca3510139b90c9370.delta /opt/stack/data/nova/instances/snapshots/tmp7gq427ov/772abd017f9241aca3510139b90c9370" returned: 0 in 0.365s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Snapshot extracted, beginning image upload
Apr 14 17:18:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Snapshot image upload complete
Apr 14 17:18:18 user nova-compute[71689]: INFO nova.compute.manager [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Took 4.59 seconds to snapshot the instance on the hypervisor.
Apr 14 17:18:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:23 user nova-compute[71689]: INFO nova.compute.manager [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Terminating instance
Apr 14 17:18:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:18:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-unplugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-unplugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-unplugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Instance destroyed successfully.
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.objects.instance [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lazy-loading 'resources' on Instance uuid d5dd90e8-4232-4f87-ac96-a5a142e3370c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-510926440',display_name='tempest-VolumesActionsTest-instance-510926440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-510926440',id=28,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65ed93a0cc2a4b2689cd9d26b7f73a14',ramdisk_id='',reservation_id='r-p0qr8fx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-355349757',owner_user_name='tempest-VolumesActionsTest-355349757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:16:40Z,user_data=None,user_id='8312ebadc8bf438dbc01dc42c6257a08',uuid=d5dd90e8-4232-4f87-ac96-a5a142e3370c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converting VIF {"id": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "address": "fa:16:3e:7d:97:b3", "network": {"id": "e0777a60-b3a9-4754-b081-75d81284a3fd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115487839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "65ed93a0cc2a4b2689cd9d26b7f73a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130d0e48-7e", "ovs_interfaceid": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG os_vif [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap130d0e48-7e, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:18:24 user nova-compute[71689]: INFO os_vif [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:97:b3,bridge_name='br-int',has_traffic_filtering=True,id=130d0e48-7ee6-4fe7-9a2d-7ef5042e966b,network=Network(e0777a60-b3a9-4754-b081-75d81284a3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130d0e48-7e')
Apr 14 17:18:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Deleting instance files /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c_del
Apr 14 17:18:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Deletion of /opt/stack/data/nova/instances/d5dd90e8-4232-4f87-ac96-a5a142e3370c_del complete
Apr 14 17:18:24 user nova-compute[71689]: INFO nova.compute.manager [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 17:18:24 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:18:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:25 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:18:25 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Took 0.92 seconds to deallocate network for instance.
Apr 14 17:18:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:25 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:18:25 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:18:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:26 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Deleted allocations for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:26 user nova-compute[71689]: WARNING nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state deleted and task_state None.
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:26 user nova-compute[71689]: WARNING nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state deleted and task_state None.
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:26 user nova-compute[71689]: WARNING nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state deleted and task_state None.
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-unplugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-unplugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:26 user nova-compute[71689]: WARNING nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-unplugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state deleted and task_state None.
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Acquiring lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "d5dd90e8-4232-4f87-ac96-a5a142e3370c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] No waiting events found dispatching network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:26 user nova-compute[71689]: WARNING nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received unexpected event network-vif-plugged-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance with vm_state deleted and task_state None.
Apr 14 17:18:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Received event network-vif-deleted-130d0e48-7ee6-4fe7-9a2d-7ef5042e966b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:18:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:18:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:18:31 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7924MB free_disk=26.136547088623047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Applying migration context for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 as it has an incoming, in-progress migration 7a4ecf85-1bc8-445d-969a-3fde978d6390. Migration status is finished {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 17:18:31 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating resource usage from migration 7a4ecf85-1bc8-445d-969a-3fde978d6390
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Migration 7a4ecf85-1bc8-445d-969a-3fde978d6390 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:18:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:18:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:18:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:18:32 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:18:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:18:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:18:39 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492704.5761936, d5dd90e8-4232-4f87-ac96-a5a142e3370c => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:18:39 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] VM Stopped (Lifecycle Event)
Apr 14 17:18:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-31f23b40-5437-43cb-91bb-21c9b8ec75ff None None] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:18:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Port de268504-352a-4d08-8113-a2098b794478 binding to destination host user is already ACTIVE {{(pid=71689) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:18:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Creating tmpfile /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/tmpnxps7cry to verify with other compute node that the instance is on the same shared storage. {{(pid=71689) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:18:58 user nova-compute[71689]: WARNING nova.compute.manager [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state resized and task_state resize_reverting.
Apr 14 17:18:58 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance destroyed successfully.
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde268504-35, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:18:58 user nova-compute[71689]: INFO os_vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:18:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:18:58 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb0074-4cae-4c66-979b-edf5aa2287a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:18:58 user nova-compute[71689]: No targets found.
Apr 14 17:18:58 user nova-compute[71689]: iSNS:
Apr 14 17:18:58 user nova-compute[71689]: No targets found.
Apr 14 17:18:58 user nova-compute[71689]: STATIC:
Apr 14 17:18:58 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae
Apr 14 17:18:58 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:18:58 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:18:58 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:18:58 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:18:58 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:18:58 user nova-compute[71689]: FIRMWARE:
Apr 14 17:18:58 user nova-compute[71689]: No targets found.
Apr 14 17:18:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:18:58 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:18:58 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b0bf47-cf2a-4a30-a389-a4c76473b9d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff48a6-cc39-4d25-91bc-144938ef7ee4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:18:58 user nova-compute[71689]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:18:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:18:58 user nova-compute[71689]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:18:58 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c72ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7721c2f-a911-4484-8e37-91349b6b78fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d5b3e0-d1bb-4e3f-9830-70a089bae9f6]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e0acb-73e2-425e-9112-45da0ffb6494]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:18:58 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3958d79e-4486-4341-9a03-f52c1485bc3d]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6970632-81bf-447d-8ae9-387cf9d1051c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24dfc9-0b2a-4c2d-90f1-0c5d1f9fcf9e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]
Apr 14 17:18:59 user nova-compute[71689]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.
Apr 14 17:18:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[430fbcf4-02ca-4a0f-a388-77615879a179]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (306ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:18:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'migration_context' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:00 user nova-compute[71689]: WARNING nova.compute.manager [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state resized and task_state resize_reverting.
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.373s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:00 user nova-compute[71689]: INFO nova.compute.manager [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Swapping old allocation on dict_keys(['4b579fd6-14ac-45a2-8022-c2739351dd91']) held by migration 7a4ecf85-1bc8-445d-969a-3fde978d6390 for instance
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Overwriting current allocation {'allocations': {'4b579fd6-14ac-45a2-8022-c2739351dd91': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 34}}, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'consumer_generation': 1} on consumer 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-84c02556-abf7-4832-a1b2-a2c28a7f8e52" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG os_brick.utils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacba87f-f881-4494-b170-5eb169e9453e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[946006c7-e693-47d2-b172-f0d8bb567b6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28247878-54d2-41f3-a73c-7d3eea0c729d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3292e5-a52e-4ff9-87a7-48099e1568a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:19:01 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:19:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95aa9ab-ad4c-4cfe-8e45-8969c2a507f4]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:19:01 user nova-compute[71689]: DEBUG os_brick.utils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:19:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Starting finish_revert_migration {{(pid=71689) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start _get_guest_xml network_info=[{"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84c02556-abf7-4832-a1b2-a2c28a7f8e52', 'attached_at': '2023-04-14T17:19:06.000000', 'detached_at': '', 'volume_id': 'dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'serial': 'dc2e1bba-01b7-42d9-8760-d569da7c4fae'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '68f9c800-3797-4ca9-9730-dcd7a04c5033', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:19:06 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:06 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:19:06 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:19:06 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:19:06 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd2211a-b582-4952-b31e-f4fe873b71a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:19:06 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4da146-5d8c-4523-845f-f0c2752690e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae] added
Apr 14 17:19:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3423c7-d37e-4900-a433-3468ac596046]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[886bf10f-402f-4e94-9987-7285feb9010d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwaTsbyx {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwaTsbyx" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[702d87a5-bcbb-4467-8bcb-531b7c728ebb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BwaTsbyx'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83fb24-cde3-46ff-bbd2-76d2459a542c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db5d0aa-a1ee-4aa8-8fe4-3c573638242f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c53c0-0431-41a0-a635-dde1460d45fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]
Apr 14 17:19:06 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.
Apr 14 17:19:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c60b6-5359-4c1b-bec1-a32f83c7c35e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[06355f62-37a0-43c4-ac03-c47c1b130e51]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:06 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:06 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:06 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b646c-62f6-44d4-8e50-7335adefe242]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:06 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23364646136353839', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364646136353839', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:19:07 user nova-compute[71689]:   <uuid>84c02556-abf7-4832-a1b2-a2c28a7f8e52</uuid>
Apr 14 17:19:07 user nova-compute[71689]:   <name>instance-00000010</name>
Apr 14 17:19:07 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:19:07 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:19:07 user nova-compute[71689]:   <metadata>
Apr 14 17:19:07 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:19:07 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:19:07 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-595094216</nova:name>
Apr 14 17:19:07 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:19:06</nova:creationTime>
Apr 14 17:19:07 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:19:07 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:19:07 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:19:07 user nova-compute[71689]:       <nova:owner>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:19:07 user nova-compute[71689]:       </nova:owner>
Apr 14 17:19:07 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:19:07 user nova-compute[71689]:       <nova:ports>
Apr 14 17:19:07 user nova-compute[71689]:         <nova:port uuid="de268504-352a-4d08-8113-a2098b794478">
Apr 14 17:19:07 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:19:07 user nova-compute[71689]:         </nova:port>
Apr 14 17:19:07 user nova-compute[71689]:       </nova:ports>
Apr 14 17:19:07 user nova-compute[71689]:     </nova:instance>
Apr 14 17:19:07 user nova-compute[71689]:   </metadata>
Apr 14 17:19:07 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:19:07 user nova-compute[71689]:     <system>
Apr 14 17:19:07 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:19:07 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:19:07 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:19:07 user nova-compute[71689]:       <entry name="serial">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:19:07 user nova-compute[71689]:       <entry name="uuid">84c02556-abf7-4832-a1b2-a2c28a7f8e52</entry>
Apr 14 17:19:07 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:19:07 user nova-compute[71689]:     </system>
Apr 14 17:19:07 user nova-compute[71689]:   </sysinfo>
Apr 14 17:19:07 user nova-compute[71689]:   <os>
Apr 14 17:19:07 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:19:07 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:19:07 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:19:07 user nova-compute[71689]:   </os>
Apr 14 17:19:07 user nova-compute[71689]:   <features>
Apr 14 17:19:07 user nova-compute[71689]:     <acpi/>
Apr 14 17:19:07 user nova-compute[71689]:     <apic/>
Apr 14 17:19:07 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:19:07 user nova-compute[71689]:   </features>
Apr 14 17:19:07 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:19:07 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:19:07 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:19:07 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:19:07 user nova-compute[71689]:   </clock>
Apr 14 17:19:07 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:19:07 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:19:07 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:19:07 user nova-compute[71689]:   </cpu>
Apr 14 17:19:07 user nova-compute[71689]:   <devices>
Apr 14 17:19:07 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:19:07 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:19:07 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk"/>
Apr 14 17:19:07 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:19:07 user nova-compute[71689]:     </disk>
Apr 14 17:19:07 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:19:07 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:19:07 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:19:07 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:19:07 user nova-compute[71689]:       <serial>dc2e1bba-01b7-42d9-8760-d569da7c4fae</serial>
Apr 14 17:19:07 user nova-compute[71689]:     </disk>
Apr 14 17:19:07 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:19:07 user nova-compute[71689]:       <mac address="fa:16:3e:0a:01:98"/>
Apr 14 17:19:07 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:07 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:19:07 user nova-compute[71689]:       <target dev="tapde268504-35"/>
Apr 14 17:19:07 user nova-compute[71689]:     </interface>
Apr 14 17:19:07 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:19:07 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/console.log" append="off"/>
Apr 14 17:19:07 user nova-compute[71689]:     </serial>
Apr 14 17:19:07 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:19:07 user nova-compute[71689]:     <video>
Apr 14 17:19:07 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:07 user nova-compute[71689]:     </video>
Apr 14 17:19:07 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:19:07 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:19:07 user nova-compute[71689]:     </rng>
Apr 14 17:19:07 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:19:07 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:19:07 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:19:07 user nova-compute[71689]:     </memballoon>
Apr 14 17:19:07 user nova-compute[71689]:   </devices>
Apr 14 17:19:07 user nova-compute[71689]: </domain>
Apr 14 17:19:07 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG os_vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde268504-35, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde268504-35, col_values=(('external_ids', {'iface-id': 'de268504-352a-4d08-8113-a2098b794478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:01:98', 'vm-uuid': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:19:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:07 user nova-compute[71689]: INFO os_vif [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:19:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG nova.compute.manager [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG nova.compute.manager [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:09 user nova-compute[71689]: WARNING nova.compute.manager [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state resized and task_state resize_reverting.
Apr 14 17:19:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 84c02556-abf7-4832-a1b2-a2c28a7f8e52 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492751.4536417, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Resumed (Lifecycle Event)
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:19:11 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance running successfully.
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] finish_revert_migration finished successfully. {{(pid=71689) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:11 user nova-compute[71689]: WARNING nova.compute.manager [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state resized and task_state resize_reverting.
Apr 14 17:19:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492751.4555295, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Started (Lifecycle Event)
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:11 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 17:19:11 user nova-compute[71689]: INFO nova.compute.manager [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance to original state: 'active'
Apr 14 17:19:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:19:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:19:19 user nova-compute[71689]: INFO nova.compute.claims [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Claim successful on node user
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:19:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.policy [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:19:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Creating image(s)
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.173s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.163s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk 1073741824" returned: 0 in 0.060s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Cannot resize image /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.objects.instance [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'migration_context' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Ensure instance console log exists: /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:19:21 user nova-compute[71689]: INFO nova.compute.claims [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Claim successful on node user
Apr 14 17:19:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Successfully created port: 0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:19:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:19:22 user nova-compute[71689]: INFO nova.virt.block_device [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Booting with volume-backed-image b0124a46-3c94-42d9-9961-82730022fc5b at /dev/vda
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.policy [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Successfully updated port: 0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing instance network info cache due to event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance network_info: |[{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Start _get_guest_xml network_info=[{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:19:23 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:23 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1625534792',display_name='tempest-ServerRescueNegativeTestJSON-server-1625534792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1625534792',id=30,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkhzx0v+7HCaZJW3pk9TowcDAVJ9KFpdiCNY5OOsCtGsGIFyP4OqSdppPhYkTIq5yQOHS6w//2BPtL2ClUJ4uuMEC/DjDyTWFx1NhxIBjDDsrLaSzKGJ838USTQRm0i2Q==',key_name='tempest-keypair-167549610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-9d98m502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2434278fe61447fab1f5a930aa16a1de',uuid=0cf7a0ce-87a0-4a24-8410-26d056e8816c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.objects.instance [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Successfully created port: 9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:19:23 user nova-compute[71689]:   <uuid>0cf7a0ce-87a0-4a24-8410-26d056e8816c</uuid>
Apr 14 17:19:23 user nova-compute[71689]:   <name>instance-0000001e</name>
Apr 14 17:19:23 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:19:23 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:19:23 user nova-compute[71689]:   <metadata>
Apr 14 17:19:23 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:19:23 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:19:23 user nova-compute[71689]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1625534792</nova:name>
Apr 14 17:19:23 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:19:23</nova:creationTime>
Apr 14 17:19:23 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:19:23 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:19:23 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:19:23 user nova-compute[71689]:       <nova:owner>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:user uuid="2434278fe61447fab1f5a930aa16a1de">tempest-ServerRescueNegativeTestJSON-2056337871-project-member</nova:user>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:project uuid="070c6b9f620548b183904d1971f35752">tempest-ServerRescueNegativeTestJSON-2056337871</nova:project>
Apr 14 17:19:23 user nova-compute[71689]:       </nova:owner>
Apr 14 17:19:23 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:19:23 user nova-compute[71689]:       <nova:ports>
Apr 14 17:19:23 user nova-compute[71689]:         <nova:port uuid="0880f945-0fa6-4f84-a9ea-71c15e634ac7">
Apr 14 17:19:23 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 17:19:23 user nova-compute[71689]:         </nova:port>
Apr 14 17:19:23 user nova-compute[71689]:       </nova:ports>
Apr 14 17:19:23 user nova-compute[71689]:     </nova:instance>
Apr 14 17:19:23 user nova-compute[71689]:   </metadata>
Apr 14 17:19:23 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:19:23 user nova-compute[71689]:     <system>
Apr 14 17:19:23 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:19:23 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:19:23 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:19:23 user nova-compute[71689]:       <entry name="serial">0cf7a0ce-87a0-4a24-8410-26d056e8816c</entry>
Apr 14 17:19:23 user nova-compute[71689]:       <entry name="uuid">0cf7a0ce-87a0-4a24-8410-26d056e8816c</entry>
Apr 14 17:19:23 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:19:23 user nova-compute[71689]:     </system>
Apr 14 17:19:23 user nova-compute[71689]:   </sysinfo>
Apr 14 17:19:23 user nova-compute[71689]:   <os>
Apr 14 17:19:23 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:19:23 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:19:23 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:19:23 user nova-compute[71689]:   </os>
Apr 14 17:19:23 user nova-compute[71689]:   <features>
Apr 14 17:19:23 user nova-compute[71689]:     <acpi/>
Apr 14 17:19:23 user nova-compute[71689]:     <apic/>
Apr 14 17:19:23 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:19:23 user nova-compute[71689]:   </features>
Apr 14 17:19:23 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:19:23 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:19:23 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:19:23 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:19:23 user nova-compute[71689]:   </clock>
Apr 14 17:19:23 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:19:23 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:19:23 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:19:23 user nova-compute[71689]:   </cpu>
Apr 14 17:19:23 user nova-compute[71689]:   <devices>
Apr 14 17:19:23 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:19:23 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:19:23 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk"/>
Apr 14 17:19:23 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:19:23 user nova-compute[71689]:     </disk>
Apr 14 17:19:23 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:19:23 user nova-compute[71689]:       <mac address="fa:16:3e:ff:b9:cd"/>
Apr 14 17:19:23 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:23 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:19:23 user nova-compute[71689]:       <target dev="tap0880f945-0f"/>
Apr 14 17:19:23 user nova-compute[71689]:     </interface>
Apr 14 17:19:23 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:19:23 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/console.log" append="off"/>
Apr 14 17:19:23 user nova-compute[71689]:     </serial>
Apr 14 17:19:23 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:19:23 user nova-compute[71689]:     <video>
Apr 14 17:19:23 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:23 user nova-compute[71689]:     </video>
Apr 14 17:19:23 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:19:23 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:19:23 user nova-compute[71689]:     </rng>
Apr 14 17:19:23 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:19:23 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:19:23 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:19:23 user nova-compute[71689]:     </memballoon>
Apr 14 17:19:23 user nova-compute[71689]:   </devices>
Apr 14 17:19:23 user nova-compute[71689]: </domain>
Apr 14 17:19:23 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1625534792',display_name='tempest-ServerRescueNegativeTestJSON-server-1625534792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1625534792',id=30,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkhzx0v+7HCaZJW3pk9TowcDAVJ9KFpdiCNY5OOsCtGsGIFyP4OqSdppPhYkTIq5yQOHS6w//2BPtL2ClUJ4uuMEC/DjDyTWFx1NhxIBjDDsrLaSzKGJ838USTQRm0i2Q==',key_name='tempest-keypair-167549610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-9d98m502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2434278fe61447fab1f5a930aa16a1de',uuid=0cf7a0ce-87a0-4a24-8410-26d056e8816c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG os_vif [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0880f945-0f, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0880f945-0f, col_values=(('external_ids', {'iface-id': '0880f945-0fa6-4f84-a9ea-71c15e634ac7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:b9:cd', 'vm-uuid': '0cf7a0ce-87a0-4a24-8410-26d056e8816c'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:23 user nova-compute[71689]: INFO os_vif [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f')
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:ff:b9:cd, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updated VIF entry in instance network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG nova.network.neutron [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Successfully updated port: 9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-changed-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Refreshing instance network info cache due to event network-changed-9262ab81-5611-4d5e-b32b-082b3c4981fd. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Acquiring lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updating instance_info_cache with network_info: [{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance network_info: |[{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Acquired lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:24 user nova-compute[71689]: DEBUG nova.network.neutron [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Refreshing network info cache for port 9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:25 user nova-compute[71689]: WARNING nova.compute.manager [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state building and task_state spawning.
Apr 14 17:19:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG nova.network.neutron [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updated VIF entry in instance network info cache for port 9262ab81-5611-4d5e-b32b-082b3c4981fd. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG nova.network.neutron [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updating instance_info_cache with network_info: [{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Releasing lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:27 user nova-compute[71689]: WARNING nova.compute.manager [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state building and task_state spawning.
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492767.5813854, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Resumed (Lifecycle Event)
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:19:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance spawned successfully.
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492767.5814984, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Started (Lifecycle Event)
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:19:27 user nova-compute[71689]: INFO nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Took 7.08 seconds to spawn the instance on the hypervisor.
Apr 14 17:19:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:28 user nova-compute[71689]: INFO nova.compute.manager [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Took 8.44 seconds to build instance.
Apr 14 17:19:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.777s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:28 user nova-compute[71689]: DEBUG os_brick.utils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:19:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed6468-6f83-42c6-9130-b77379ff3030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c2bf0a-0af8-437d-bd82-39b94decde7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164970c-59a1-4a83-8ae9-83a5783eab0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf7c1c-44e0-41ae-9c71-4a18615f791a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:19:29 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:19:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000de12-c357-4dcf-af99-987ad514f5b2]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG os_brick.utils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== get_connector_properties: return (234ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updating existing volume attachment record: 2cdf536b-1b15-4773-b72e-00decb6b538f {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:19:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:19:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:34 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:34 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:34 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8001MB free_disk=25.825286865234375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:19:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:19:35 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Creating image(s)
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Ensure instance console log exists: /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Start _get_guest_xml network_info=[{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '99e98b6d-e5dd-49b7-b5ec-fba07fed70b3', 'attached_at': '', 'detached_at': '', 'volume_id': '05bb9c07-31ea-4c72-9153-5df8be147d28', 'serial': '05bb9c07-31ea-4c72-9153-5df8be147d28'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '2cdf536b-1b15-4773-b72e-00decb6b538f', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:19:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:19:35 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:19:35 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:19:35 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:19:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.968s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260" returned: 21 in 0.069s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d218427b-22b8-4afb-98c3-6010492e6cd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:19:35 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d1d5fb-94b9-46f6-86d5-8b957d3b6389]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28] added
Apr 14 17:19:35 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7455e93-0680-4f32-b028-6db52f770387]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b469a3d3-9607-4eb4-98a8-5c2cc4452135]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyHsqmES {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyHsqmES" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d6484f-692e-48bd-9925-522a4addb46c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pyHsqmES'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7970f889-964d-4f24-8dca-15d6594e7398]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b1a21d-920c-4da2-86f0-cd298c03dec7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf81607d-99a2-4de5-86a0-1589560c2be5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf81607d-99a2-4de5-86a0-1589560c2be5 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf81607d-99a2-4de5-86a0-1589560c2be5 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbcc052-47cc-467b-9326-7312eaa86381]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260]
Apr 14 17:19:36 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260] successful.
Apr 14 17:19:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c14297-b02a-4ad8-849c-df4efb69a2ff]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[521f787d-cf1f-45b9-8e81-f280603d10de]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf81607d-99a2-4de5-86a0-1589560c2be5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf81607d-99a2-4de5-86a0-1589560c2be5 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf81607d-99a2-4de5-86a0-1589560c2be5 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:19:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.555s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.038s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607db3a-31fe-4844-95ca-4e6b9005fd2a]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:19:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.617s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== connect_volume: return (1620ms) {'type': 'block', 'scsi_wwn': '23231366563306630', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231366563306630', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-645603562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-645603562',id=31,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-jcsyelxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:22Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=99e98b6d-e5dd-49b7-b5ec-fba07fed70b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.objects.instance [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'pci_devices' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:19:37 user nova-compute[71689]:   <uuid>99e98b6d-e5dd-49b7-b5ec-fba07fed70b3</uuid>
Apr 14 17:19:37 user nova-compute[71689]:   <name>instance-0000001f</name>
Apr 14 17:19:37 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:19:37 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:19:37 user nova-compute[71689]:   <metadata>
Apr 14 17:19:37 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:19:37 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:19:37 user nova-compute[71689]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-645603562</nova:name>
Apr 14 17:19:37 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:19:35</nova:creationTime>
Apr 14 17:19:37 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:19:37 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:19:37 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:19:37 user nova-compute[71689]:       <nova:owner>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:user uuid="b5c86125160643958349100fb3a7855b">tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member</nova:user>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:project uuid="965bd22f61df40bd89e8ef35fb12bcd3">tempest-ServerBootFromVolumeStableRescueTest-995212803</nova:project>
Apr 14 17:19:37 user nova-compute[71689]:       </nova:owner>
Apr 14 17:19:37 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:19:37 user nova-compute[71689]:       <nova:ports>
Apr 14 17:19:37 user nova-compute[71689]:         <nova:port uuid="9262ab81-5611-4d5e-b32b-082b3c4981fd">
Apr 14 17:19:37 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 17:19:37 user nova-compute[71689]:         </nova:port>
Apr 14 17:19:37 user nova-compute[71689]:       </nova:ports>
Apr 14 17:19:37 user nova-compute[71689]:     </nova:instance>
Apr 14 17:19:37 user nova-compute[71689]:   </metadata>
Apr 14 17:19:37 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:19:37 user nova-compute[71689]:     <system>
Apr 14 17:19:37 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:19:37 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:19:37 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:19:37 user nova-compute[71689]:       <entry name="serial">99e98b6d-e5dd-49b7-b5ec-fba07fed70b3</entry>
Apr 14 17:19:37 user nova-compute[71689]:       <entry name="uuid">99e98b6d-e5dd-49b7-b5ec-fba07fed70b3</entry>
Apr 14 17:19:37 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:19:37 user nova-compute[71689]:     </system>
Apr 14 17:19:37 user nova-compute[71689]:   </sysinfo>
Apr 14 17:19:37 user nova-compute[71689]:   <os>
Apr 14 17:19:37 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:19:37 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:19:37 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:19:37 user nova-compute[71689]:   </os>
Apr 14 17:19:37 user nova-compute[71689]:   <features>
Apr 14 17:19:37 user nova-compute[71689]:     <acpi/>
Apr 14 17:19:37 user nova-compute[71689]:     <apic/>
Apr 14 17:19:37 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:19:37 user nova-compute[71689]:   </features>
Apr 14 17:19:37 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:19:37 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:19:37 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:19:37 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:19:37 user nova-compute[71689]:   </clock>
Apr 14 17:19:37 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:19:37 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:19:37 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:19:37 user nova-compute[71689]:   </cpu>
Apr 14 17:19:37 user nova-compute[71689]:   <devices>
Apr 14 17:19:37 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:19:37 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:19:37 user nova-compute[71689]:       <source dev="/dev/sde"/>
Apr 14 17:19:37 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:19:37 user nova-compute[71689]:       <serial>05bb9c07-31ea-4c72-9153-5df8be147d28</serial>
Apr 14 17:19:37 user nova-compute[71689]:     </disk>
Apr 14 17:19:37 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:19:37 user nova-compute[71689]:       <mac address="fa:16:3e:4e:b7:0b"/>
Apr 14 17:19:37 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:37 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:19:37 user nova-compute[71689]:       <target dev="tap9262ab81-56"/>
Apr 14 17:19:37 user nova-compute[71689]:     </interface>
Apr 14 17:19:37 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:19:37 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/console.log" append="off"/>
Apr 14 17:19:37 user nova-compute[71689]:     </serial>
Apr 14 17:19:37 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:19:37 user nova-compute[71689]:     <video>
Apr 14 17:19:37 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:37 user nova-compute[71689]:     </video>
Apr 14 17:19:37 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:19:37 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:19:37 user nova-compute[71689]:     </rng>
Apr 14 17:19:37 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:19:37 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:19:37 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:19:37 user nova-compute[71689]:     </memballoon>
Apr 14 17:19:37 user nova-compute[71689]:   </devices>
Apr 14 17:19:37 user nova-compute[71689]: </domain>
Apr 14 17:19:37 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-645603562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-645603562',id=31,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-jcsyelxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:22Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=99e98b6d-e5dd-49b7-b5ec-fba07fed70b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG os_vif [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9262ab81-56, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9262ab81-56, col_values=(('external_ids', {'iface-id': '9262ab81-5611-4d5e-b32b-082b3c4981fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b7:0b', 'vm-uuid': '99e98b6d-e5dd-49b7-b5ec-fba07fed70b3'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:37 user nova-compute[71689]: INFO os_vif [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56')
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:19:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No VIF found with MAC fa:16:3e:4e:b7:0b, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:39 user nova-compute[71689]: WARNING nova.compute.manager [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state building and task_state spawning.
Apr 14 17:19:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:41 user nova-compute[71689]: DEBUG nova.compute.manager [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:41 user nova-compute[71689]: WARNING nova.compute.manager [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state building and task_state spawning.
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'flavor' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492783.38241, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Resumed (Lifecycle Event)
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Attaching volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 to /dev/vdb
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance spawned successfully.
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492783.3833976, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Started (Lifecycle Event)
Apr 14 17:19:43 user nova-compute[71689]: DEBUG os_brick.utils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18bcb9-e4d5-4602-a816-5b0844e13e80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5affaefc-5e74-4dce-a4f5-0563d229fcf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Took 7.88 seconds to spawn the instance on the hypervisor.
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e029bce-96bd-42b9-8d14-f9416b7da9d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43aa76a-a442-42bd-98c6-a39109a79a6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:43 user nova-compute[71689]: INFO nova.compute.manager [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Took 22.05 seconds to build instance.
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:19:43 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[805f118c-b4c9-4800-99ed-c5553bb2fb73]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG os_brick.utils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating existing volume attachment record: c86b3586-c87e-4432-93e5-0d28231d3831 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:19:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.185s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:48 user nova-compute[71689]: INFO nova.compute.manager [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Unshelving
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'pci_requests' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'numa_topology' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:19:48 user nova-compute[71689]: INFO nova.compute.claims [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Claim successful on node user
Apr 14 17:19:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQaVeixn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:19:48 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:19:48 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:19:48 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd17eba-42c9-414d-8467-08b21da986c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:19:48 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a1693-a836-4d28-8fc1-a0db47cb4530]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027] added
Apr 14 17:19:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb8766d-821c-4685-b82e-1216daf1c539]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b4f076-1a10-43a9-b90b-a5dff1cc5767]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQaVeixn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQaVeixn" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a486480f-3266-4ac9-a878-5bb89f4fd41a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQaVeixn'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f805a603-ff83-44c2-be43-4713a39359ac]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[41681825-c07e-464a-ba46-22bb2e8cb9ad]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:48 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:48 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:19:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:48 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:48 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:19:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83da603-b761-41c0-9889-e1afc633c404]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260]
Apr 14 17:19:48 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260] successful.
Apr 14 17:19:48 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248bd92-ada6-4c6b-b818-e201f57d0974]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:48 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbf0d88-2223-44c4-b0a9-d48b9029c476]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:49 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:49 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:19:49 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:19:49 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:19:49 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:19:49 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:19:49 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:19:49 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a105e0-e26d-4e9d-a887-cb51018fca35]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:49 user nova-compute[71689]: INFO nova.network.neutron [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating port fd88804d-f436-4656-89b3-22638cb26897 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:19:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-changed-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing instance network info cache due to event network-changed-fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQaVeixn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23831613836396234', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831613836396234', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'flavor' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:19:50 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:19:50 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:19:50 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:19:50 user nova-compute[71689]:   <serial>ca8ff0ff-f007-4ffc-ab66-a99af6974027</serial>
Apr 14 17:19:50 user nova-compute[71689]: </disk>
Apr 14 17:19:50 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:19:50 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Creating image(s)
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'trusted_certs' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Refreshing network info cache for port fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "611946fa9b690c1e3938031eba0c03c997467195" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "611946fa9b690c1e3938031eba0c03c997467195" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:19:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] No VIF found with MAC fa:16:3e:14:65:80, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.051s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG nova.virt.images [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] b3a0d8d4-3bee-4204-9b1b-d85af551cb7e was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.part /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.part /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.converted" returned: 0 in 0.168s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updated VIF entry in instance network info cache for port fd88804d-f436-4656-89b3-22638cb26897. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "611946fa9b690c1e3938031eba0c03c997467195" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.371s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "611946fa9b690c1e3938031eba0c03c997467195" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "611946fa9b690c1e3938031eba0c03c997467195" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 --force-share --output=json" returned: 0 in 0.185s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195,backing_fmt=raw /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195,backing_fmt=raw /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk 1073741824" returned: 0 in 0.073s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "611946fa9b690c1e3938031eba0c03c997467195" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'migration_context' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:52 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Rebasing disk image.
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 -F raw /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 -F raw /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk" returned: 0 in 2.123s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Ensure instance console log exists: /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Start _get_guest_xml network_info=[{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='952415b29bec3c13e3ba303c53f46394',container_format='bare',created_at=2023-04-14T17:17:55Z,direct_url=<?>,disk_format='qcow2',id=b3a0d8d4-3bee-4204-9b1b-d85af551cb7e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1087117818-shelved',owner='1ae1b41823a64cd0b1c1a1669ad202ec',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T17:17:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:19:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='952415b29bec3c13e3ba303c53f46394',container_format='bare',created_at=2023-04-14T17:17:55Z,direct_url=<?>,disk_format='qcow2',id=b3a0d8d4-3bee-4204-9b1b-d85af551cb7e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1087117818-shelved',owner='1ae1b41823a64cd0b1c1a1669ad202ec',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T17:17:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1087117818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1087117818',id=26,image_ref='b3a0d8d4-3bee-4204-9b1b-d85af551cb7e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2079826628',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-3v6vpup2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member',shelved_at='2023-04-14T17:17:58.560163',shelved_host='user',shelved_image_id='b3a0d8d4-3bee-4204-9b1b-d85af551cb7e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=49931fa3-281e-43d0-a3e9-fde8f502b2cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'pci_devices' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:19:54 user nova-compute[71689]:   <uuid>49931fa3-281e-43d0-a3e9-fde8f502b2cd</uuid>
Apr 14 17:19:54 user nova-compute[71689]:   <name>instance-0000001a</name>
Apr 14 17:19:54 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:19:54 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:19:54 user nova-compute[71689]:   <metadata>
Apr 14 17:19:54 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:19:54 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:19:54 user nova-compute[71689]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1087117818</nova:name>
Apr 14 17:19:54 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:19:54</nova:creationTime>
Apr 14 17:19:54 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:19:54 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:19:54 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:19:54 user nova-compute[71689]:       <nova:owner>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:user uuid="6aa926d6cfc94b08a564404f95da5483">tempest-AttachVolumeShelveTestJSON-339689049-project-member</nova:user>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:project uuid="1ae1b41823a64cd0b1c1a1669ad202ec">tempest-AttachVolumeShelveTestJSON-339689049</nova:project>
Apr 14 17:19:54 user nova-compute[71689]:       </nova:owner>
Apr 14 17:19:54 user nova-compute[71689]:       <nova:root type="image" uuid="b3a0d8d4-3bee-4204-9b1b-d85af551cb7e"/>
Apr 14 17:19:54 user nova-compute[71689]:       <nova:ports>
Apr 14 17:19:54 user nova-compute[71689]:         <nova:port uuid="fd88804d-f436-4656-89b3-22638cb26897">
Apr 14 17:19:54 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:19:54 user nova-compute[71689]:         </nova:port>
Apr 14 17:19:54 user nova-compute[71689]:       </nova:ports>
Apr 14 17:19:54 user nova-compute[71689]:     </nova:instance>
Apr 14 17:19:54 user nova-compute[71689]:   </metadata>
Apr 14 17:19:54 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:19:54 user nova-compute[71689]:     <system>
Apr 14 17:19:54 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:19:54 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:19:54 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:19:54 user nova-compute[71689]:       <entry name="serial">49931fa3-281e-43d0-a3e9-fde8f502b2cd</entry>
Apr 14 17:19:54 user nova-compute[71689]:       <entry name="uuid">49931fa3-281e-43d0-a3e9-fde8f502b2cd</entry>
Apr 14 17:19:54 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:19:54 user nova-compute[71689]:     </system>
Apr 14 17:19:54 user nova-compute[71689]:   </sysinfo>
Apr 14 17:19:54 user nova-compute[71689]:   <os>
Apr 14 17:19:54 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:19:54 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:19:54 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:19:54 user nova-compute[71689]:   </os>
Apr 14 17:19:54 user nova-compute[71689]:   <features>
Apr 14 17:19:54 user nova-compute[71689]:     <acpi/>
Apr 14 17:19:54 user nova-compute[71689]:     <apic/>
Apr 14 17:19:54 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:19:54 user nova-compute[71689]:   </features>
Apr 14 17:19:54 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:19:54 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:19:54 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:19:54 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:19:54 user nova-compute[71689]:   </clock>
Apr 14 17:19:54 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:19:54 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:19:54 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:19:54 user nova-compute[71689]:   </cpu>
Apr 14 17:19:54 user nova-compute[71689]:   <devices>
Apr 14 17:19:54 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:19:54 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:19:54 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk"/>
Apr 14 17:19:54 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:19:54 user nova-compute[71689]:     </disk>
Apr 14 17:19:54 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:19:54 user nova-compute[71689]:       <mac address="fa:16:3e:99:49:0f"/>
Apr 14 17:19:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:54 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:19:54 user nova-compute[71689]:       <target dev="tapfd88804d-f4"/>
Apr 14 17:19:54 user nova-compute[71689]:     </interface>
Apr 14 17:19:54 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:19:54 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/console.log" append="off"/>
Apr 14 17:19:54 user nova-compute[71689]:     </serial>
Apr 14 17:19:54 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:19:54 user nova-compute[71689]:     <video>
Apr 14 17:19:54 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:19:54 user nova-compute[71689]:     </video>
Apr 14 17:19:54 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:19:54 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:19:54 user nova-compute[71689]:     </rng>
Apr 14 17:19:54 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:19:54 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:19:54 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:19:54 user nova-compute[71689]:     </memballoon>
Apr 14 17:19:54 user nova-compute[71689]:   </devices>
Apr 14 17:19:54 user nova-compute[71689]: </domain>
Apr 14 17:19:54 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1087117818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1087117818',id=26,image_ref='b3a0d8d4-3bee-4204-9b1b-d85af551cb7e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2079826628',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-3v6vpup2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member',shelved_at='2023-04-14T17:17:58.560163',shelved_host='user',shelved_image_id='b3a0d8d4-3bee-4204-9b1b-d85af551cb7e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=49931fa3-281e-43d0-a3e9-fde8f502b2cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG os_vif [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing instance network info cache due to event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG nova.network.neutron [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd88804d-f4, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd88804d-f4, col_values=(('external_ids', {'iface-id': 'fd88804d-f436-4656-89b3-22638cb26897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:49:0f', 'vm-uuid': '49931fa3-281e-43d0-a3e9-fde8f502b2cd'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:54 user nova-compute[71689]: INFO os_vif [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4')
Apr 14 17:19:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:19:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] No VIF found with MAC fa:16:3e:99:49:0f, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:19:55 user nova-compute[71689]: DEBUG nova.network.neutron [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updated VIF entry in instance network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:19:55 user nova-compute[71689]: DEBUG nova.network.neutron [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:56 user nova-compute[71689]: WARNING nova.compute.manager [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 17:19:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing instance network info cache due to event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.network.neutron [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492798.8822236, 49931fa3-281e-43d0-a3e9-fde8f502b2cd => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] VM Resumed (Lifecycle Event)
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:19:58 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance spawned successfully.
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492798.8843226, 49931fa3-281e-43d0-a3e9-fde8f502b2cd => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:19:58 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] VM Started (Lifecycle Event)
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:19:58 user nova-compute[71689]: WARNING nova.compute.manager [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:19:59 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:19:59 user nova-compute[71689]: INFO nova.compute.manager [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Rebooting instance
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updated VIF entry in instance network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.807s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:19:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance shutdown successfully.
Apr 14 17:20:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-unplugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-unplugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:02 user nova-compute[71689]: WARNING nova.compute.manager [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-unplugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state active and task_state reboot_started.
Apr 14 17:20:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:05 user nova-compute[71689]: WARNING nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state active and task_state reboot_started.
Apr 14 17:20:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:05 user nova-compute[71689]: WARNING nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state active and task_state reboot_started.
Apr 14 17:20:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:05 user nova-compute[71689]: DEBUG nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:05 user nova-compute[71689]: WARNING nova.compute.manager [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state active and task_state reboot_started.
Apr 14 17:20:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492806.7150567, 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:20:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] VM Resumed (Lifecycle Event)
Apr 14 17:20:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance running successfully.
Apr 14 17:20:06 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance soft rebooted successfully.
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:20:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492806.7166102, 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:20:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] VM Started (Lifecycle Event)
Apr 14 17:20:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.803s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:20:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:20:15 user nova-compute[71689]: INFO nova.compute.claims [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Claim successful on node user
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:20:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.policy [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:20:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Creating image(s)
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "/opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "/opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "/opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk 1073741824" returned: 0 in 0.060s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Cannot resize image /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG nova.objects.instance [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'migration_context' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Ensure instance console log exists: /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Successfully created port: 4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Successfully updated port: 4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquired lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.compute.manager [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-changed-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.compute.manager [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Refreshing instance network info cache due to event network-changed-4e3c902c-c5f1-4842-8338-fc701ab2e11a. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Acquiring lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating instance_info_cache with network_info: [{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Releasing lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Instance network_info: |[{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Acquired lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Refreshing network info cache for port 4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Start _get_guest_xml network_info=[{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:20:18 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:20:18 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1834940939',display_name='tempest-TestStampPattern-server-1834940939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1834940939',id=32,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA==',key_name='tempest-TestStampPattern-1893968129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ab08f97dd54832a7cc975934b1b69f',ramdisk_id='',reservation_id='r-zf8clj6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-872060463',owner_user_name='tempest-TestStampPattern-872060463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:20:17Z,user_data=None,user_id='b8ea39d187c842788168909de203455e',uuid=15a48598-5e5d-450b-a6c5-d7637a6d8682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converting VIF {"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.objects.instance [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'pci_devices' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:20:18 user nova-compute[71689]:   <uuid>15a48598-5e5d-450b-a6c5-d7637a6d8682</uuid>
Apr 14 17:20:18 user nova-compute[71689]:   <name>instance-00000020</name>
Apr 14 17:20:18 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:20:18 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:20:18 user nova-compute[71689]:   <metadata>
Apr 14 17:20:18 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:20:18 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:20:18 user nova-compute[71689]:       <nova:name>tempest-TestStampPattern-server-1834940939</nova:name>
Apr 14 17:20:18 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:20:18</nova:creationTime>
Apr 14 17:20:18 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:20:18 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:20:18 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:20:18 user nova-compute[71689]:       <nova:owner>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:user uuid="b8ea39d187c842788168909de203455e">tempest-TestStampPattern-872060463-project-member</nova:user>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:project uuid="f7ab08f97dd54832a7cc975934b1b69f">tempest-TestStampPattern-872060463</nova:project>
Apr 14 17:20:18 user nova-compute[71689]:       </nova:owner>
Apr 14 17:20:18 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:20:18 user nova-compute[71689]:       <nova:ports>
Apr 14 17:20:18 user nova-compute[71689]:         <nova:port uuid="4e3c902c-c5f1-4842-8338-fc701ab2e11a">
Apr 14 17:20:18 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 17:20:18 user nova-compute[71689]:         </nova:port>
Apr 14 17:20:18 user nova-compute[71689]:       </nova:ports>
Apr 14 17:20:18 user nova-compute[71689]:     </nova:instance>
Apr 14 17:20:18 user nova-compute[71689]:   </metadata>
Apr 14 17:20:18 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:20:18 user nova-compute[71689]:     <system>
Apr 14 17:20:18 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:20:18 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:20:18 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:20:18 user nova-compute[71689]:       <entry name="serial">15a48598-5e5d-450b-a6c5-d7637a6d8682</entry>
Apr 14 17:20:18 user nova-compute[71689]:       <entry name="uuid">15a48598-5e5d-450b-a6c5-d7637a6d8682</entry>
Apr 14 17:20:18 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:20:18 user nova-compute[71689]:     </system>
Apr 14 17:20:18 user nova-compute[71689]:   </sysinfo>
Apr 14 17:20:18 user nova-compute[71689]:   <os>
Apr 14 17:20:18 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:20:18 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:20:18 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:20:18 user nova-compute[71689]:   </os>
Apr 14 17:20:18 user nova-compute[71689]:   <features>
Apr 14 17:20:18 user nova-compute[71689]:     <acpi/>
Apr 14 17:20:18 user nova-compute[71689]:     <apic/>
Apr 14 17:20:18 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:20:18 user nova-compute[71689]:   </features>
Apr 14 17:20:18 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:20:18 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:20:18 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:20:18 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:20:18 user nova-compute[71689]:   </clock>
Apr 14 17:20:18 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:20:18 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:20:18 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:20:18 user nova-compute[71689]:   </cpu>
Apr 14 17:20:18 user nova-compute[71689]:   <devices>
Apr 14 17:20:18 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:20:18 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:20:18 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk"/>
Apr 14 17:20:18 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:20:18 user nova-compute[71689]:     </disk>
Apr 14 17:20:18 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:20:18 user nova-compute[71689]:       <mac address="fa:16:3e:67:85:45"/>
Apr 14 17:20:18 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:20:18 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:20:18 user nova-compute[71689]:       <target dev="tap4e3c902c-c5"/>
Apr 14 17:20:18 user nova-compute[71689]:     </interface>
Apr 14 17:20:18 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:20:18 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/console.log" append="off"/>
Apr 14 17:20:18 user nova-compute[71689]:     </serial>
Apr 14 17:20:18 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:20:18 user nova-compute[71689]:     <video>
Apr 14 17:20:18 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:20:18 user nova-compute[71689]:     </video>
Apr 14 17:20:18 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:20:18 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:20:18 user nova-compute[71689]:     </rng>
Apr 14 17:20:18 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:20:18 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:20:18 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:20:18 user nova-compute[71689]:     </memballoon>
Apr 14 17:20:18 user nova-compute[71689]:   </devices>
Apr 14 17:20:18 user nova-compute[71689]: </domain>
Apr 14 17:20:18 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1834940939',display_name='tempest-TestStampPattern-server-1834940939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1834940939',id=32,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA==',key_name='tempest-TestStampPattern-1893968129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ab08f97dd54832a7cc975934b1b69f',ramdisk_id='',reservation_id='r-zf8clj6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-872060463',owner_user_name='tempest-TestStampPattern-872060463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:20:17Z,user_data=None,user_id='b8ea39d187c842788168909de203455e',uuid=15a48598-5e5d-450b-a6c5-d7637a6d8682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converting VIF {"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG os_vif [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e3c902c-c5, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e3c902c-c5, col_values=(('external_ids', {'iface-id': '4e3c902c-c5f1-4842-8338-fc701ab2e11a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:85:45', 'vm-uuid': '15a48598-5e5d-450b-a6c5-d7637a6d8682'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:18 user nova-compute[71689]: INFO os_vif [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5')
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:20:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No VIF found with MAC fa:16:3e:67:85:45, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:20:19 user nova-compute[71689]: DEBUG nova.network.neutron [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updated VIF entry in instance network info cache for port 4e3c902c-c5f1-4842-8338-fc701ab2e11a. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:20:19 user nova-compute[71689]: DEBUG nova.network.neutron [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating instance_info_cache with network_info: [{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:20:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Releasing lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] No waiting events found dispatching network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:20 user nova-compute[71689]: WARNING nova.compute.manager [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received unexpected event network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance with vm_state building and task_state spawning.
Apr 14 17:20:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492822.6038792, 15a48598-5e5d-450b-a6c5-d7637a6d8682 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] VM Resumed (Lifecycle Event)
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Instance spawned successfully.
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492822.6080449, 15a48598-5e5d-450b-a6c5-d7637a6d8682 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] VM Started (Lifecycle Event)
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] No waiting events found dispatching network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:22 user nova-compute[71689]: WARNING nova.compute.manager [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received unexpected event network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance with vm_state building and task_state spawning.
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 14 17:20:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:22 user nova-compute[71689]: INFO nova.compute.manager [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Took 6.90 seconds to build instance.
Apr 14 17:20:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.997s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid a3e1f09c-567e-41d1-9c35-58b8371a1d1c {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:20:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:20:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=26.087757110595703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:20:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.678s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:39 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:20:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:20:44 user nova-compute[71689]: INFO nova.compute.claims [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Claim successful on node user
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:20:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:20:44 user nova-compute[71689]: DEBUG nova.policy [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecae496b720c4e09b90986969d9ae9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3e0c3b9c7b4ca79b75def0f04f5549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:20:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Creating image(s)
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "/opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "/opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk 1073741824" returned: 0 in 0.046s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Successfully created port: 7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Cannot resize image /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'migration_context' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Ensure instance console log exists: /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Successfully updated port: 7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquired lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-changed-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Refreshing instance network info cache due to event network-changed-7549a60b-8755-4baa-bf6b-6571c0cbb88b. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Acquiring lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating instance_info_cache with network_info: [{"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Releasing lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Instance network_info: |[{"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Acquired lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.neutron [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Refreshing network info cache for port 7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Start _get_guest_xml network_info=[{"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:20:46 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:20:46 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-880884795',display_name='tempest-SnapshotDataIntegrityTests-server-880884795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-880884795',id=33,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME8aoJyi0vLQ0MCxGXeBzoEE4eLG4CfEQiz1k6/xiDjKOq15pBqG+t7b9GfO5oOEKJaRgYDThOzcI9kcGOzCkBEuKkYPt0LUpXKhM6Yh6bYcd6WF1/PXpn6j5rcw/py5A==',key_name='tempest-SnapshotDataIntegrityTests-1467007685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3e0c3b9c7b4ca79b75def0f04f5549',ramdisk_id='',reservation_id='r-qx3j7and',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1230410658',owner_user_name='tempest-SnapshotDataIntegrityTests-1230410658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:20:45Z,user_data=None,user_id='ecae496b720c4e09b90986969d9ae9fa',uuid=15ce59e7-b263-4e0b-9f19-638db9606c7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Converting VIF {"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:20:46 user nova-compute[71689]:   <uuid>15ce59e7-b263-4e0b-9f19-638db9606c7b</uuid>
Apr 14 17:20:46 user nova-compute[71689]:   <name>instance-00000021</name>
Apr 14 17:20:46 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:20:46 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:20:46 user nova-compute[71689]:   <metadata>
Apr 14 17:20:46 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:20:46 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:20:46 user nova-compute[71689]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-880884795</nova:name>
Apr 14 17:20:46 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:20:46</nova:creationTime>
Apr 14 17:20:46 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:20:46 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:20:46 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:20:46 user nova-compute[71689]:       <nova:owner>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:user uuid="ecae496b720c4e09b90986969d9ae9fa">tempest-SnapshotDataIntegrityTests-1230410658-project-member</nova:user>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:project uuid="5e3e0c3b9c7b4ca79b75def0f04f5549">tempest-SnapshotDataIntegrityTests-1230410658</nova:project>
Apr 14 17:20:46 user nova-compute[71689]:       </nova:owner>
Apr 14 17:20:46 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:20:46 user nova-compute[71689]:       <nova:ports>
Apr 14 17:20:46 user nova-compute[71689]:         <nova:port uuid="7549a60b-8755-4baa-bf6b-6571c0cbb88b">
Apr 14 17:20:46 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:20:46 user nova-compute[71689]:         </nova:port>
Apr 14 17:20:46 user nova-compute[71689]:       </nova:ports>
Apr 14 17:20:46 user nova-compute[71689]:     </nova:instance>
Apr 14 17:20:46 user nova-compute[71689]:   </metadata>
Apr 14 17:20:46 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:20:46 user nova-compute[71689]:     <system>
Apr 14 17:20:46 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:20:46 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:20:46 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:20:46 user nova-compute[71689]:       <entry name="serial">15ce59e7-b263-4e0b-9f19-638db9606c7b</entry>
Apr 14 17:20:46 user nova-compute[71689]:       <entry name="uuid">15ce59e7-b263-4e0b-9f19-638db9606c7b</entry>
Apr 14 17:20:46 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:20:46 user nova-compute[71689]:     </system>
Apr 14 17:20:46 user nova-compute[71689]:   </sysinfo>
Apr 14 17:20:46 user nova-compute[71689]:   <os>
Apr 14 17:20:46 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:20:46 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:20:46 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:20:46 user nova-compute[71689]:   </os>
Apr 14 17:20:46 user nova-compute[71689]:   <features>
Apr 14 17:20:46 user nova-compute[71689]:     <acpi/>
Apr 14 17:20:46 user nova-compute[71689]:     <apic/>
Apr 14 17:20:46 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:20:46 user nova-compute[71689]:   </features>
Apr 14 17:20:46 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:20:46 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:20:46 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:20:46 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:20:46 user nova-compute[71689]:   </clock>
Apr 14 17:20:46 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:20:46 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:20:46 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:20:46 user nova-compute[71689]:   </cpu>
Apr 14 17:20:46 user nova-compute[71689]:   <devices>
Apr 14 17:20:46 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:20:46 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:20:46 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk"/>
Apr 14 17:20:46 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:20:46 user nova-compute[71689]:     </disk>
Apr 14 17:20:46 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:20:46 user nova-compute[71689]:       <mac address="fa:16:3e:d6:23:b6"/>
Apr 14 17:20:46 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:20:46 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:20:46 user nova-compute[71689]:       <target dev="tap7549a60b-87"/>
Apr 14 17:20:46 user nova-compute[71689]:     </interface>
Apr 14 17:20:46 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:20:46 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/console.log" append="off"/>
Apr 14 17:20:46 user nova-compute[71689]:     </serial>
Apr 14 17:20:46 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:20:46 user nova-compute[71689]:     <video>
Apr 14 17:20:46 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:20:46 user nova-compute[71689]:     </video>
Apr 14 17:20:46 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:20:46 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:20:46 user nova-compute[71689]:     </rng>
Apr 14 17:20:46 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:20:46 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:20:46 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:20:46 user nova-compute[71689]:     </memballoon>
Apr 14 17:20:46 user nova-compute[71689]:   </devices>
Apr 14 17:20:46 user nova-compute[71689]: </domain>
Apr 14 17:20:46 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-880884795',display_name='tempest-SnapshotDataIntegrityTests-server-880884795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-880884795',id=33,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME8aoJyi0vLQ0MCxGXeBzoEE4eLG4CfEQiz1k6/xiDjKOq15pBqG+t7b9GfO5oOEKJaRgYDThOzcI9kcGOzCkBEuKkYPt0LUpXKhM6Yh6bYcd6WF1/PXpn6j5rcw/py5A==',key_name='tempest-SnapshotDataIntegrityTests-1467007685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3e0c3b9c7b4ca79b75def0f04f5549',ramdisk_id='',reservation_id='r-qx3j7and',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1230410658',owner_user_name='tempest-SnapshotDataIntegrityTests-1230410658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:20:45Z,user_data=None,user_id='ecae496b720c4e09b90986969d9ae9fa',uuid=15ce59e7-b263-4e0b-9f19-638db9606c7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Converting VIF {"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG os_vif [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7549a60b-87, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7549a60b-87, col_values=(('external_ids', {'iface-id': '7549a60b-8755-4baa-bf6b-6571c0cbb88b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:23:b6', 'vm-uuid': '15ce59e7-b263-4e0b-9f19-638db9606c7b'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:46 user nova-compute[71689]: INFO os_vif [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87')
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:20:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No VIF found with MAC fa:16:3e:d6:23:b6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:20:47 user nova-compute[71689]: DEBUG nova.network.neutron [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updated VIF entry in instance network info cache for port 7549a60b-8755-4baa-bf6b-6571c0cbb88b. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:20:47 user nova-compute[71689]: DEBUG nova.network.neutron [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating instance_info_cache with network_info: [{"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:20:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Releasing lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:20:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] No waiting events found dispatching network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:48 user nova-compute[71689]: WARNING nova.compute.manager [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received unexpected event network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance with vm_state building and task_state spawning.
Apr 14 17:20:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492850.1642926, 15ce59e7-b263-4e0b-9f19-638db9606c7b => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] VM Resumed (Lifecycle Event)
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Instance spawned successfully.
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] No waiting events found dispatching network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:20:50 user nova-compute[71689]: WARNING nova.compute.manager [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received unexpected event network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance with vm_state building and task_state spawning.
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492850.1679616, 15ce59e7-b263-4e0b-9f19-638db9606c7b => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] VM Started (Lifecycle Event)
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Took 5.29 seconds to spawn the instance on the hypervisor.
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:20:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:20:50 user nova-compute[71689]: INFO nova.compute.manager [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Took 6.08 seconds to build instance.
Apr 14 17:20:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.194s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:20:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:20:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:21:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing instance network info cache due to event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.objects.instance [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:11 user nova-compute[71689]: INFO nova.compute.manager [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Attaching volume 5380e47e-86ce-482e-b6d7-b756348399d5 to /dev/vdb
Apr 14 17:21:11 user nova-compute[71689]: DEBUG os_brick.utils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f39d3c-f9a9-44d1-afac-7d92601d62ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5ee195-c34b-465a-bdb6-ab74d6c8852b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd7e388-eed2-4118-a896-1efc409016ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59853bc2-f84b-41a0-91ae-2cb2fd896bef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updated VIF entry in instance network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.network.neutron [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:21:11 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:21:11 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[03297f1e-e487-4989-9162-10faa15c5d7f]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG os_brick.utils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating existing volume attachment record: d902bc04-a619-4dd2-a935-c73a4c4ec36a {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:21:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:12 user nova-compute[71689]: INFO nova.compute.manager [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Rescuing
Apr 14 17:21:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:21:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:21:12 user nova-compute[71689]: DEBUG nova.network.neutron [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:21:12 user nova-compute[71689]: DEBUG nova.network.neutron [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updating instance_info_cache with network_info: [{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:21:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:13 user nova-compute[71689]: WARNING nova.compute.manager [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state rescuing.
Apr 14 17:21:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance destroyed successfully.
Apr 14 17:21:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Attempting a stable device rescue
Apr 14 17:21:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71689) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:21:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Creating image(s)
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "/opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "/opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'trusted_certs' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "a1ec845f84f620eb7028c539715fb4689e12d283" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a1ec845f84f620eb7028c539715fb4689e12d283" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG nova.virt.images [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 9ee807dd-e685-47e5-93fb-e53deedeac4c was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.part /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.part /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.converted" returned: 0 in 0.246s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a1ec845f84f620eb7028c539715fb4689e12d283" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.356s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "a1ec845f84f620eb7028c539715fb4689e12d283" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a1ec845f84f620eb7028c539715fb4689e12d283" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:15 user nova-compute[71689]: WARNING nova.compute.manager [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state rescuing.
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283 --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283,backing_fmt=raw /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283,backing_fmt=raw /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue" returned: 0 in 0.059s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a1ec845f84f620eb7028c539715fb4689e12d283" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'migration_context' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Start _get_guest_xml network_info=[{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "vif_mac": "fa:16:3e:4e:b7:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9ee807dd-e685-47e5-93fb-e53deedeac4c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '99e98b6d-e5dd-49b7-b5ec-fba07fed70b3', 'attached_at': '', 'detached_at': '', 'volume_id': '05bb9c07-31ea-4c72-9153-5df8be147d28', 'serial': '05bb9c07-31ea-4c72-9153-5df8be147d28'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '2cdf536b-1b15-4773-b72e-00decb6b538f', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'resources' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'numa_topology' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:15 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:21:15 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:21:15 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:21:15 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:21:15 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62c754e-9afd-431a-baeb-3b7d654488c0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pyHsqmES\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 17:21:15 user nova-compute[71689]: node.name = iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:21:15 user nova-compute[71689]: node.tpgt = -1
Apr 14 17:21:15 user nova-compute[71689]: node.startup = automatic
Apr 14 17:21:15 user nova-compute[71689]: node.leading_login = No
Apr 14 17:21:15 user nova-compute[71689]: iface.iscsi_ifacename = default
Apr 14 17:21:15 user nova-compute[71689]: iface.net_ifacename = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.ipaddress = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.prefix_len = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.hwaddress = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.transport_name = tcp
Apr 14 17:21:15 user nova-compute[71689]: iface.initiatorname = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.vlan_id = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.vlan_priority = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.vlan_state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.iface_num = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.mtu = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.port = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.bootproto = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.subnet_mask = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.gateway = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_alt_client_id = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_dns = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_learn_iqn = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_vendor_id_state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_vendor_id = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.dhcp_slp_da = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.fragmentation = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.gratuitous_arp = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.incoming_forwarding = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.tos_state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.tos = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.ttl = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.delayed_ack = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.tcp_nagle = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.tcp_wsf_state = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.tcp_wsf = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.tcp_timer_scale = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.tcp_timestamp = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.redirect = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.def_task_mgmt_timeout = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.header_digest = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.data_digest = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.immediate_data = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.initial_r2t = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.data_seq_inorder = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.data_pdu_inorder = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.erl = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.max_receive_data_len = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.first_burst_len = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.max_outstanding_r2t = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.max_burst_len = 0
Apr 14 17:21:15 user nova-compute[71689]: iface.chap_auth = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.bidi_chap = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.strict_login_compliance = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.discovery_auth = <empty>
Apr 14 17:21:15 user nova-compute[71689]: iface.discovery_logout = <empty>
Apr 14 17:21:15 user nova-compute[71689]: node.discovery_address = <empty>
Apr 14 17:21:15 user nova-compute[71689]: node.discovery_port = 0
Apr 14 17:21:15 user nova-compute[71689]: node.discovery_type = static
Apr 14 17:21:15 user nova-compute[71689]: node.session.initial_cmdsn = 0
Apr 14 17:21:15 user nova-compute[71689]: node.session.initial_login_retry_max = 8
Apr 14 17:21:15 user nova-compute[71689]: node.session.xmit_thread_priority = -20
Apr 14 17:21:15 user nova-compute[71689]: node.session.cmds_max = 128
Apr 14 17:21:15 user nova-compute[71689]: node.session.queue_depth = 32
Apr 14 17:21:15 user nova-compute[71689]: node.session.nr_sessions = 1
Apr 14 17:21:15 user nova-compute[71689]: node.session.auth.authmethod = CHAP
Apr 14 17:21:15 user nova-compute[71689]: node.session.auth.username = pyHsqmES
Apr 14 17:21:15 user nova-compute[71689]: node.session.auth.password = ***
Apr 14 17:21:15 user nova-compute[71689]: node.session.auth.username_in = <empty>
Apr 14 17:21:15 user nova-compute[71689]: node.session.auth.password_in = <empty>
Apr 14 17:21:15 user nova-compute[71689]: node.session.auth.chap_algs = MD5
Apr 14 17:21:15 user nova-compute[71689]: node.session.timeo.replacement_timeout = 120
Apr 14 17:21:15 user nova-compute[71689]: node.session.err_timeo.abort_timeout = 15
Apr 14 17:21:15 user nova-compute[71689]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 17:21:15 user nova-compute[71689]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 17:21:15 user nova-compute[71689]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.FastAbort = Yes
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.InitialR2T = No
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.ImmediateData = Yes
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.MaxConnections = 1
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 17:21:15 user nova-compute[71689]: node.session.iscsi.ERL = 0
Apr 14 17:21:15 user nova-compute[71689]: node.session.scan = manual
Apr 14 17:21:15 user nova-compute[71689]: node.session.reopen_max = 0
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].address = 172.16.0.220
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].port = 3260
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].startup = manual
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].tcp.window_size = 524288
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].tcp.type_of_service = 0
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].timeo.logout_timeout = 15
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].timeo.login_timeout = 15
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].timeo.auth_timeout = 45
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].iscsi.DataDigest = None
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].iscsi.IFMarker = No
Apr 14 17:21:15 user nova-compute[71689]: node.conn[0].iscsi.OFMarker = No
Apr 14 17:21:15 user nova-compute[71689]: # END RECORD
Apr 14 17:21:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[777860ee-ef7f-4677-b01d-9194934ae405]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d46531-703b-48eb-b3c6-c83bbdc68f91]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyHsqmES {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyHsqmES" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa3e9c2-a014-4f3a-ac68-3107dffda68c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pyHsqmES'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa30213-c5a2-4098-abdd-10ed2ffdc4c5]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff650c8-3fbf-45c1-a2ab-4d8da0a5fd69]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:15 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:15 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:15 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:15 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:15 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:15 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:15 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HCTL ('36', '0', '0', 0) found on session 34 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb1abe-d408-47d6-891c-a192a616ee33]: (4, ('0 0 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Searching for a device in session 34 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23231366563306630', 'path': '/dev/sde'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231366563306630', 'path': '/dev/sde'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-645603562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-645603562',id=31,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-jcsyelxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:44Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=99e98b6d-e5dd-49b7-b5ec-fba07fed70b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "vif_mac": "fa:16:3e:4e:b7:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "vif_mac": "fa:16:3e:4e:b7:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'pci_devices' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:21:15 user nova-compute[71689]:   <uuid>99e98b6d-e5dd-49b7-b5ec-fba07fed70b3</uuid>
Apr 14 17:21:15 user nova-compute[71689]:   <name>instance-0000001f</name>
Apr 14 17:21:15 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:21:15 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:21:15 user nova-compute[71689]:   <metadata>
Apr 14 17:21:15 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:21:15 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:21:15 user nova-compute[71689]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-645603562</nova:name>
Apr 14 17:21:15 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:21:15</nova:creationTime>
Apr 14 17:21:15 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:21:15 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:21:15 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:21:15 user nova-compute[71689]:       <nova:owner>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:user uuid="b5c86125160643958349100fb3a7855b">tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member</nova:user>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:project uuid="965bd22f61df40bd89e8ef35fb12bcd3">tempest-ServerBootFromVolumeStableRescueTest-995212803</nova:project>
Apr 14 17:21:15 user nova-compute[71689]:       </nova:owner>
Apr 14 17:21:15 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:21:15 user nova-compute[71689]:       <nova:ports>
Apr 14 17:21:15 user nova-compute[71689]:         <nova:port uuid="9262ab81-5611-4d5e-b32b-082b3c4981fd">
Apr 14 17:21:15 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 17:21:15 user nova-compute[71689]:         </nova:port>
Apr 14 17:21:15 user nova-compute[71689]:       </nova:ports>
Apr 14 17:21:15 user nova-compute[71689]:     </nova:instance>
Apr 14 17:21:15 user nova-compute[71689]:   </metadata>
Apr 14 17:21:15 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:21:15 user nova-compute[71689]:     <system>
Apr 14 17:21:15 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:21:15 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:21:15 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:21:15 user nova-compute[71689]:       <entry name="serial">99e98b6d-e5dd-49b7-b5ec-fba07fed70b3</entry>
Apr 14 17:21:15 user nova-compute[71689]:       <entry name="uuid">99e98b6d-e5dd-49b7-b5ec-fba07fed70b3</entry>
Apr 14 17:21:15 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:21:15 user nova-compute[71689]:     </system>
Apr 14 17:21:15 user nova-compute[71689]:   </sysinfo>
Apr 14 17:21:15 user nova-compute[71689]:   <os>
Apr 14 17:21:15 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:21:15 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:21:15 user nova-compute[71689]:   </os>
Apr 14 17:21:15 user nova-compute[71689]:   <features>
Apr 14 17:21:15 user nova-compute[71689]:     <acpi/>
Apr 14 17:21:15 user nova-compute[71689]:     <apic/>
Apr 14 17:21:15 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:21:15 user nova-compute[71689]:   </features>
Apr 14 17:21:15 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:21:15 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:21:15 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:21:15 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:21:15 user nova-compute[71689]:   </clock>
Apr 14 17:21:15 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:21:15 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:21:15 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:21:15 user nova-compute[71689]:   </cpu>
Apr 14 17:21:15 user nova-compute[71689]:   <devices>
Apr 14 17:21:15 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:21:15 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:21:15 user nova-compute[71689]:       <source dev="/dev/sde"/>
Apr 14 17:21:15 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:21:15 user nova-compute[71689]:       <serial>05bb9c07-31ea-4c72-9153-5df8be147d28</serial>
Apr 14 17:21:15 user nova-compute[71689]:     </disk>
Apr 14 17:21:15 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:21:15 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:21:15 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue"/>
Apr 14 17:21:15 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:21:15 user nova-compute[71689]:       <boot order="1"/>
Apr 14 17:21:15 user nova-compute[71689]:     </disk>
Apr 14 17:21:15 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:21:15 user nova-compute[71689]:       <mac address="fa:16:3e:4e:b7:0b"/>
Apr 14 17:21:15 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:21:15 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:21:15 user nova-compute[71689]:       <target dev="tap9262ab81-56"/>
Apr 14 17:21:15 user nova-compute[71689]:     </interface>
Apr 14 17:21:15 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:21:15 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/console.log" append="off"/>
Apr 14 17:21:15 user nova-compute[71689]:     </serial>
Apr 14 17:21:15 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:21:15 user nova-compute[71689]:     <video>
Apr 14 17:21:15 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:21:15 user nova-compute[71689]:     </video>
Apr 14 17:21:15 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:21:15 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:21:15 user nova-compute[71689]:     </rng>
Apr 14 17:21:15 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:21:15 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:21:15 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:21:15 user nova-compute[71689]:     </memballoon>
Apr 14 17:21:15 user nova-compute[71689]:   </devices>
Apr 14 17:21:15 user nova-compute[71689]: </domain>
Apr 14 17:21:15 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:21:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance destroyed successfully.
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:21:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] No VIF found with MAC fa:16:3e:4e:b7:0b, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUAfqYQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:21:16 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:21:16 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:21:16 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e6e80-60fd-4f40-bbba-2e111adfe216]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:21:16 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a6c199-4c22-4835-8876-1d3ec461d361]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5] added
Apr 14 17:21:16 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf2426-2e34-4662-b7f1-491b816f7c31]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f541188f-e50b-4d8e-b82b-e4affda0e2e9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUAfqYQN {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUAfqYQN" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3979a3-559c-47a3-9772-66714dda7e79]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUAfqYQN'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d87b50-7f81-49d8-9007-ccd8cd093d7b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a43a84-2878-4789-9b06-ebb487ed7809]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e8cad-9bd7-485b-ad85-f9f19c7558c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260]
Apr 14 17:21:16 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260] successful.
Apr 14 17:21:16 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc29b47-d4d1-4011-8989-60d56ee684c5]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfaee9b-fad1-420c-8655-e5f60157e653]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:21:16 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[40739e40-f3d4-4211-9495-9038422f859b]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUAfqYQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:21:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:17 user nova-compute[71689]: WARNING nova.compute.manager [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state rescuing.
Apr 14 17:21:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26231306231323737', 'path': '/dev/sdf'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231306231323737', 'path': '/dev/sdf'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG nova.objects.instance [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:21:17 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:21:17 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:21:17 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:21:17 user nova-compute[71689]:   <serial>5380e47e-86ce-482e-b6d7-b756348399d5</serial>
Apr 14 17:21:17 user nova-compute[71689]: </disk>
Apr 14 17:21:17 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:21:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:21:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:21:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:ff:b9:cd, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:21:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.852s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:19 user nova-compute[71689]: INFO nova.compute.manager [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Rescuing
Apr 14 17:21:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492879.2243369, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:21:19 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Resumed (Lifecycle Event)
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:21:19 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492879.228201, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:21:19 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Started (Lifecycle Event)
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:19 user nova-compute[71689]: WARNING nova.compute.manager [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state rescuing.
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:20 user nova-compute[71689]: WARNING nova.compute.manager [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state active and task_state rescuing.
Apr 14 17:21:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance destroyed successfully.
Apr 14 17:21:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Attempting rescue
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71689) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:21:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Creating image(s)
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue" returned: 0 in 0.053s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'migration_context' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Start _get_guest_xml network_info=[{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:ff:b9:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'resources' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'numa_topology' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:20 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:21:20 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:21:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1625534792',display_name='tempest-ServerRescueNegativeTestJSON-server-1625534792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1625534792',id=30,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkhzx0v+7HCaZJW3pk9TowcDAVJ9KFpdiCNY5OOsCtGsGIFyP4OqSdppPhYkTIq5yQOHS6w//2BPtL2ClUJ4uuMEC/DjDyTWFx1NhxIBjDDsrLaSzKGJ838USTQRm0i2Q==',key_name='tempest-keypair-167549610',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-9d98m502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2434278fe61447fab1f5a930aa16a1de',uuid=0cf7a0ce-87a0-4a24-8410-26d056e8816c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:ff:b9:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "vif_mac": "fa:16:3e:ff:b9:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:21:21 user nova-compute[71689]:   <uuid>0cf7a0ce-87a0-4a24-8410-26d056e8816c</uuid>
Apr 14 17:21:21 user nova-compute[71689]:   <name>instance-0000001e</name>
Apr 14 17:21:21 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:21:21 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:21:21 user nova-compute[71689]:   <metadata>
Apr 14 17:21:21 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:21:21 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:21:21 user nova-compute[71689]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1625534792</nova:name>
Apr 14 17:21:21 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:21:20</nova:creationTime>
Apr 14 17:21:21 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:21:21 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:21:21 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:21:21 user nova-compute[71689]:       <nova:owner>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:user uuid="2434278fe61447fab1f5a930aa16a1de">tempest-ServerRescueNegativeTestJSON-2056337871-project-member</nova:user>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:project uuid="070c6b9f620548b183904d1971f35752">tempest-ServerRescueNegativeTestJSON-2056337871</nova:project>
Apr 14 17:21:21 user nova-compute[71689]:       </nova:owner>
Apr 14 17:21:21 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:21:21 user nova-compute[71689]:       <nova:ports>
Apr 14 17:21:21 user nova-compute[71689]:         <nova:port uuid="0880f945-0fa6-4f84-a9ea-71c15e634ac7">
Apr 14 17:21:21 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 17:21:21 user nova-compute[71689]:         </nova:port>
Apr 14 17:21:21 user nova-compute[71689]:       </nova:ports>
Apr 14 17:21:21 user nova-compute[71689]:     </nova:instance>
Apr 14 17:21:21 user nova-compute[71689]:   </metadata>
Apr 14 17:21:21 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:21:21 user nova-compute[71689]:     <system>
Apr 14 17:21:21 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:21:21 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:21:21 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:21:21 user nova-compute[71689]:       <entry name="serial">0cf7a0ce-87a0-4a24-8410-26d056e8816c</entry>
Apr 14 17:21:21 user nova-compute[71689]:       <entry name="uuid">0cf7a0ce-87a0-4a24-8410-26d056e8816c</entry>
Apr 14 17:21:21 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:21:21 user nova-compute[71689]:     </system>
Apr 14 17:21:21 user nova-compute[71689]:   </sysinfo>
Apr 14 17:21:21 user nova-compute[71689]:   <os>
Apr 14 17:21:21 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:21:21 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:21:21 user nova-compute[71689]:   </os>
Apr 14 17:21:21 user nova-compute[71689]:   <features>
Apr 14 17:21:21 user nova-compute[71689]:     <acpi/>
Apr 14 17:21:21 user nova-compute[71689]:     <apic/>
Apr 14 17:21:21 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:21:21 user nova-compute[71689]:   </features>
Apr 14 17:21:21 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:21:21 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:21:21 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:21:21 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:21:21 user nova-compute[71689]:   </clock>
Apr 14 17:21:21 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:21:21 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:21:21 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:21:21 user nova-compute[71689]:   </cpu>
Apr 14 17:21:21 user nova-compute[71689]:   <devices>
Apr 14 17:21:21 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:21:21 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:21:21 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue"/>
Apr 14 17:21:21 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:21:21 user nova-compute[71689]:     </disk>
Apr 14 17:21:21 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:21:21 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:21:21 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk"/>
Apr 14 17:21:21 user nova-compute[71689]:       <target dev="vdb" bus="virtio"/>
Apr 14 17:21:21 user nova-compute[71689]:     </disk>
Apr 14 17:21:21 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:21:21 user nova-compute[71689]:       <mac address="fa:16:3e:ff:b9:cd"/>
Apr 14 17:21:21 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:21:21 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:21:21 user nova-compute[71689]:       <target dev="tap0880f945-0f"/>
Apr 14 17:21:21 user nova-compute[71689]:     </interface>
Apr 14 17:21:21 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:21:21 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/console.log" append="off"/>
Apr 14 17:21:21 user nova-compute[71689]:     </serial>
Apr 14 17:21:21 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:21:21 user nova-compute[71689]:     <video>
Apr 14 17:21:21 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:21:21 user nova-compute[71689]:     </video>
Apr 14 17:21:21 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:21:21 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:21:21 user nova-compute[71689]:     </rng>
Apr 14 17:21:21 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:21:21 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:21:21 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:21:21 user nova-compute[71689]:     </memballoon>
Apr 14 17:21:21 user nova-compute[71689]:   </devices>
Apr 14 17:21:21 user nova-compute[71689]: </domain>
Apr 14 17:21:21 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:21:21 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance destroyed successfully.
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] No VIF found with MAC fa:16:3e:ff:b9:cd, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:21:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:22 user nova-compute[71689]: WARNING nova.compute.manager [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state active and task_state rescuing.
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 0cf7a0ce-87a0-4a24-8410-26d056e8816c due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492884.635699, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:21:24 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Resumed (Lifecycle Event)
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:24 user nova-compute[71689]: WARNING nova.compute.manager [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state active and task_state rescuing.
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:24 user nova-compute[71689]: WARNING nova.compute.manager [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state active and task_state rescuing.
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:21:24 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492884.6372123, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:21:24 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Started (Lifecycle Event)
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:21:24 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 17:21:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [{"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-49931fa3-281e-43d0-a3e9-fde8f502b2cd" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:21:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:21:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:30 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:21:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:21:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=25.974872589111328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:21:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:21:36 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:21:36 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:21:36 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:21:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:38 user nova-compute[71689]: INFO nova.compute.manager [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Terminating instance
Apr 14 17:21:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-unplugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-unplugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-unplugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:21:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Instance destroyed successfully.
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'resources' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1087117818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1087117818',id=26,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmu0k6XkCj93lDjab3hWIuIddTxIIe6New3tssd+lQXrZvNkzrJwGACl6up5dJSwaMP2JphmLRtB0WeXyM7HltVl/Wuya2YOuiNr8wsIufy9MKTweL9xsZymU8LiqDqeA==',key_name='tempest-keypair-2079826628',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:19:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae1b41823a64cd0b1c1a1669ad202ec',ramdisk_id='',reservation_id='r-3v6vpup2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-339689049',owner_user_name='tempest-AttachVolumeShelveTestJSON-339689049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6aa926d6cfc94b08a564404f95da5483',uuid=49931fa3-281e-43d0-a3e9-fde8f502b2cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converting VIF {"id": "fd88804d-f436-4656-89b3-22638cb26897", "address": "fa:16:3e:99:49:0f", "network": {"id": "f49ab827-654e-4ae2-838a-52bfad1c0937", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1186897610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae1b41823a64cd0b1c1a1669ad202ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd88804d-f4", "ovs_interfaceid": "fd88804d-f436-4656-89b3-22638cb26897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG os_vif [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd88804d-f4, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:21:39 user nova-compute[71689]: INFO os_vif [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:49:0f,bridge_name='br-int',has_traffic_filtering=True,id=fd88804d-f436-4656-89b3-22638cb26897,network=Network(f49ab827-654e-4ae2-838a-52bfad1c0937),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd88804d-f4')
Apr 14 17:21:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Deleting instance files /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd_del
Apr 14 17:21:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Deletion of /opt/stack/data/nova/instances/49931fa3-281e-43d0-a3e9-fde8f502b2cd_del complete
Apr 14 17:21:39 user nova-compute[71689]: INFO nova.compute.manager [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 17:21:39 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:21:39 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:39 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Took 0.76 seconds to deallocate network for instance.
Apr 14 17:21:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-deleted-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:40 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Deleted allocations for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Acquiring lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Lock "49931fa3-281e-43d0-a3e9-fde8f502b2cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] No waiting events found dispatching network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:40 user nova-compute[71689]: WARNING nova.compute.manager [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Received unexpected event network-vif-plugged-fd88804d-f436-4656-89b3-22638cb26897 for instance with vm_state deleted and task_state None.
Apr 14 17:21:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:48 user nova-compute[71689]: INFO nova.compute.manager [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Terminating instance
Apr 14 17:21:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-unplugged-de268504-352a-4d08-8113-a2098b794478 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Instance destroyed successfully.
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.objects.instance [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-253960403',display_name='tempest-ServerActionsTestJSON-server-595094216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-253960403',id=16,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:19:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-90mzlbw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:19:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=84c02556-abf7-4832-a1b2-a2c28a7f8e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "de268504-352a-4d08-8113-a2098b794478", "address": "fa:16:3e:0a:01:98", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde268504-35", "ovs_interfaceid": "de268504-352a-4d08-8113-a2098b794478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_vif [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde268504-35, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:21:49 user nova-compute[71689]: INFO os_vif [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:98,bridge_name='br-int',has_traffic_filtering=True,id=de268504-352a-4d08-8113-a2098b794478,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde268504-35')
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwaTsbyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:21:49 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e29ab5b-01cb-443d-90d5-30e161f4577e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:21:49 user nova-compute[71689]: No targets found.
Apr 14 17:21:49 user nova-compute[71689]: iSNS:
Apr 14 17:21:49 user nova-compute[71689]: No targets found.
Apr 14 17:21:49 user nova-compute[71689]: STATIC:
Apr 14 17:21:49 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027
Apr 14 17:21:49 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:49 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:49 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:21:49 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:49 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:49 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae
Apr 14 17:21:49 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:49 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:49 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:21:49 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:49 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:49 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:21:49 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:49 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:49 user nova-compute[71689]: FIRMWARE:
Apr 14 17:21:49 user nova-compute[71689]: No targets found.
Apr 14 17:21:49 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:21:49 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:21:49 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a392992-199c-476f-9293-83cecfb93df8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6292a3-af06-46c3-872d-5d629af726ef]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:21:49 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c72a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ce893-ce40-4fa2-875d-12a183e42e2d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33afc12-6da5-4afe-8711-78d34aa87e7f]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c03b5f3-5724-4f42-86ba-afab5c546c7a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d7be3e-2139-4a57-a93f-dc2830676be2]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fef620-fec7-4805-ab3f-4ea5bde79023]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa285b63-ae77-4483-b1d5-6cdd13083d9f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260]
Apr 14 17:21:49 user nova-compute[71689]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae, portal: 172.16.0.220,3260] successful.
Apr 14 17:21:49 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2e1bba-01b7-42d9-8760-d569da7c4fae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb4440c-380f-462f-9a9f-b733981288e0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (337ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:21:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Deleting instance files /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_del
Apr 14 17:21:49 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Deletion of /opt/stack/data/nova/instances/84c02556-abf7-4832-a1b2-a2c28a7f8e52_del complete
Apr 14 17:21:49 user nova-compute[71689]: INFO nova.compute.manager [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 17:21:49 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:21:49 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:21:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:50 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:50 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Took 0.71 seconds to deallocate network for instance.
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing instance network info cache due to event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:21:51 user nova-compute[71689]: INFO nova.compute.manager [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Acquiring lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] No waiting events found dispatching network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:21:51 user nova-compute[71689]: WARNING nova.compute.manager [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received unexpected event network-vif-plugged-de268504-352a-4d08-8113-a2098b794478 for instance with vm_state deleted and task_state None.
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.compute.manager [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Received event network-vif-deleted-de268504-352a-4d08-8113-a2098b794478 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updated VIF entry in instance network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:51 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Deleted allocations for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52
Apr 14 17:21:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "84c02556-abf7-4832-a1b2-a2c28a7f8e52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.292s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing instance network info cache due to event network-changed-43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Acquiring lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Acquired lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.network.neutron [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Refreshing network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:21:52 user nova-compute[71689]: INFO nova.compute.manager [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Detaching volume ca8ff0ff-f007-4ffc-ab66-a99af6974027
Apr 14 17:21:52 user nova-compute[71689]: INFO nova.virt.block_device [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Attempting to driver detach volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 from mountpoint /dev/vdb
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Attempting to detach device vdb from instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:21:52 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:21:52 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:21:52 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:21:52 user nova-compute[71689]:   <serial>ca8ff0ff-f007-4ffc-ab66-a99af6974027</serial>
Apr 14 17:21:52 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:21:52 user nova-compute[71689]: </disk>
Apr 14 17:21:52 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:21:52 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully detached device vdb from instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 from the persistent domain config.
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:21:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:21:52 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:21:52 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:21:52 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:21:52 user nova-compute[71689]:   <serial>ca8ff0ff-f007-4ffc-ab66-a99af6974027</serial>
Apr 14 17:21:52 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:21:52 user nova-compute[71689]: </disk>
Apr 14 17:21:52 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG nova.network.neutron [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updated VIF entry in instance network info cache for port 43e76338-e6dd-456e-b1e2-d2f7c150f14d. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG nova.network.neutron [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [{"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Releasing lock "refresh_cache-6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492913.4542024, 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:21:53 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully detached device vdb from instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 from the live domain config.
Apr 14 17:21:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQaVeixn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:21:53 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d277aa3b-8ddd-4075-b01a-642122586e2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:21:53 user nova-compute[71689]: No targets found.
Apr 14 17:21:53 user nova-compute[71689]: iSNS:
Apr 14 17:21:53 user nova-compute[71689]: No targets found.
Apr 14 17:21:53 user nova-compute[71689]: STATIC:
Apr 14 17:21:53 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027
Apr 14 17:21:53 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:53 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:53 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:21:53 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:53 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:53 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:21:53 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:53 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:53 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:21:53 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:21:53 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:21:53 user nova-compute[71689]: FIRMWARE:
Apr 14 17:21:53 user nova-compute[71689]: No targets found.
Apr 14 17:21:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:21:53 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:21:53 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e59f2d-4ffe-448b-a2a2-c0953e3d540e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6bde18-b951-4ec7-a803-f398c7872c27]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:21:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c729000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a061b4-cfe0-4b0f-9dd0-afea1367d528]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[510cfade-fc2d-486d-8c8a-c346162ca7f6]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8d9aa-dc99-48c4-8bda-ba14969717b1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f5878-f775-4e94-8218-37a40d50fa79]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639fb3a-c70b-4c3c-a8cb-9314d5fd5318]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5de93b-762e-40d8-9eac-afbe377f4ed8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260]
Apr 14 17:21:53 user nova-compute[71689]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027, portal: 172.16.0.220,3260] successful.
Apr 14 17:21:53 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca8ff0ff-f007-4ffc-ab66-a99af6974027 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec6027-0b3e-4641-8181-11306a4488b7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] <== disconnect_volume: return (308ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:21:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:21:54 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492899.1041713, 49931fa3-281e-43d0-a3e9-fde8f502b2cd => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:21:54 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] VM Stopped (Lifecycle Event)
Apr 14 17:21:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c8294100-98cf-45b3-b9c3-aeee3c1d61ea None None] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:21:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:54 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'flavor' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:21:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:21:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:21:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:04 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492909.370713, 84c02556-abf7-4832-a1b2-a2c28a7f8e52 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:22:04 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] VM Stopped (Lifecycle Event)
Apr 14 17:22:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-2fd9dcd9-c0e9-400b-93cd-2f4ad1da88d8 None None] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-changed-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Refreshing instance network info cache due to event network-changed-4e3c902c-c5f1-4842-8338-fc701ab2e11a. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Acquiring lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Acquired lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG nova.network.neutron [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Refreshing network info cache for port 4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG nova.objects.instance [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'flavor' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG nova.network.neutron [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updated VIF entry in instance network info cache for port 4e3c902c-c5f1-4842-8338-fc701ab2e11a. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG nova.network.neutron [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating instance_info_cache with network_info: [{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:08 user nova-compute[71689]: INFO nova.compute.manager [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Attaching volume 7a4503ad-f051-411d-a9c8-b5900017cda6 to /dev/vdb
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Releasing lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG os_brick.utils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48d5693-1011-4ebf-b2fb-c686b30468bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[81407dfc-c1a3-4e5e-8cdb-58f96bf1c570]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6860ef3-05e0-4fb5-9bc2-c94380fbdfc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1e07d-95ee-4cd0-a7e3-b7d6842bcf7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:22:08 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:22:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaf884d-8003-4122-ad73-6e21afa87ee6]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:22:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:22:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:22:09 user nova-compute[71689]: DEBUG os_brick.utils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:22:09 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating existing volume attachment record: eb6ad41a-273b-4e02-809e-334335885819 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:22:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElRWdwuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:22:13 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:22:13 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:22:13 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7be1d5-6ebb-4606-a76d-1dd3772688e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:22:13 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eda2d68-7350-47c6-9848-53981845bf7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6] added
Apr 14 17:22:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a63c1-4f36-484d-a17e-6156a7d09ce6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9063c8-be7d-4f74-8b7e-982ed62b8bd5]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElRWdwuh {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElRWdwuh" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c345d008-1b64-4154-a81a-76ac038457dd]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ElRWdwuh'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f0927-d8c6-4903-8ee8-b7a10f7c5a50]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a75ff8-bc75-4667-a692-ae1489ac9572]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20cdba7-8454-4df2-845b-7160778c010a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260]
Apr 14 17:22:13 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260] successful.
Apr 14 17:22:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d00690e-fb24-4006-bf1e-9847b668756d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e3af85-bcca-4594-8eb2-2b8bcac6a74b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 (non-flash)
Apr 14 17:22:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b275427-f413-4c43-8490-b9daf60c1c1f]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:22:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElRWdwuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:22:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:22:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23533313261336430', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:22:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533313261336430', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:22:14 user nova-compute[71689]: DEBUG nova.objects.instance [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'flavor' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:22:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:22:14 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:22:14 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:22:14 user nova-compute[71689]:   <serial>7a4503ad-f051-411d-a9c8-b5900017cda6</serial>
Apr 14 17:22:14 user nova-compute[71689]: </disk>
Apr 14 17:22:14 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:22:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:22:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:22:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No VIF found with MAC fa:16:3e:67:85:45, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:22:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.503s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:17 user nova-compute[71689]: INFO nova.compute.manager [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Detaching volume 7a4503ad-f051-411d-a9c8-b5900017cda6
Apr 14 17:22:17 user nova-compute[71689]: INFO nova.virt.block_device [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Attempting to driver detach volume 7a4503ad-f051-411d-a9c8-b5900017cda6 from mountpoint /dev/vdb
Apr 14 17:22:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Attempting to detach device vdb from instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:22:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:22:17 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:22:17 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:22:17 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:22:17 user nova-compute[71689]:   <serial>7a4503ad-f051-411d-a9c8-b5900017cda6</serial>
Apr 14 17:22:17 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:22:17 user nova-compute[71689]: </disk>
Apr 14 17:22:17 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:22:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully detached device vdb from instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 from the persistent domain config.
Apr 14 17:22:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:22:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:22:17 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:22:17 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:22:17 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:22:17 user nova-compute[71689]:   <serial>7a4503ad-f051-411d-a9c8-b5900017cda6</serial>
Apr 14 17:22:17 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:22:17 user nova-compute[71689]: </disk>
Apr 14 17:22:17 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492938.0392876, 15a48598-5e5d-450b-a6c5-d7637a6d8682 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:22:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully detached device vdb from instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 from the live domain config.
Apr 14 17:22:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElRWdwuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:22:18 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea583a-0e23-4f24-8b8b-26753d676042]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:22:18 user nova-compute[71689]: No targets found.
Apr 14 17:22:18 user nova-compute[71689]: iSNS:
Apr 14 17:22:18 user nova-compute[71689]: No targets found.
Apr 14 17:22:18 user nova-compute[71689]: STATIC:
Apr 14 17:22:18 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:22:18 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:22:18 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:22:18 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6
Apr 14 17:22:18 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:22:18 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:22:18 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:22:18 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:22:18 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:22:18 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:22:18 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:22:18 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:22:18 user nova-compute[71689]: FIRMWARE:
Apr 14 17:22:18 user nova-compute[71689]: No targets found.
Apr 14 17:22:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:22:18 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:22:18 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9f044b-4000-48df-8a38-1babc05514d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3701c0-60f3-4673-a525-1d8d6dea4975]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 (non-flash)
Apr 14 17:22:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b5945c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6ee7af-0675-4781-b9d7-b683103c8f43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ce576-1e0f-4fe9-947e-9e0e7f3829af]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[191af786-851a-4fde-99ce-99fe3e210d93]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a6a34f-415f-4975-8afd-aedae3896fb4]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb12edd-3dc2-41c7-a861-e1112d0218ac]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66dc7c1-12a4-4a23-8fe7-6351bb042669]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260]
Apr 14 17:22:18 user nova-compute[71689]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6, portal: 172.16.0.220,3260] successful.
Apr 14 17:22:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4503ad-f051-411d-a9c8-b5900017cda6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dc4f0b-b496-4031-a630-fa5ebf33c739]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] <== disconnect_volume: return (307ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:22:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:22:19 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'flavor' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.679s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updating instance_info_cache with network_info: [{"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:22:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:22:35 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7714MB free_disk=25.993850708007812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:22:35 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:22:36 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:22:36 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:22:36 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:22:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:22:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-changed-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Refreshing instance network info cache due to event network-changed-7549a60b-8755-4baa-bf6b-6571c0cbb88b. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Acquiring lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Acquired lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Refreshing network info cache for port 7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:22:40 user nova-compute[71689]: INFO nova.compute.claims [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Claim successful on node user
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:40 user nova-compute[71689]: INFO nova.compute.manager [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attaching volume a0e1588e-3447-4cc6-8740-d7a3b6af2807 to /dev/vdb
Apr 14 17:22:40 user nova-compute[71689]: DEBUG os_brick.utils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed29093-5a7f-4567-903f-0901e37701f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3643179-945b-43b3-92a9-f1d04f61462d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updated VIF entry in instance network info cache for port 7549a60b-8755-4baa-bf6b-6571c0cbb88b. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating instance_info_cache with network_info: [{"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Releasing lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87439efa-3405-4e14-8db0-c2b9fbccf1e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b7e815-3fb0-44fa-bf43-e1d50445cde1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:22:40 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:22:40 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba357a0-eca8-47c2-af7b-79f18be1c805]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG os_brick.utils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:22:40 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating existing volume attachment record: 55145e4e-f820-4591-83d4-a5c5d2a23bcf {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:22:41 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.policy [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:22:41 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Creating image(s)
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "/opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "/opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.178s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk 1073741824" returned: 0 in 0.057s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:22:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Cannot resize image /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'migration_context' on Instance uuid 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Ensure instance console log exists: /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Successfully created port: ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Successfully updated port: ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-changed-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Refreshing instance network info cache due to event network-changed-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Acquiring lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Acquired lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Refreshing network info cache for port ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.network.neutron [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Releasing lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:22:43 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Instance network_info: |[{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Start _get_guest_xml network_info=[{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:22:44 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:22:44 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-840202433',display_name='tempest-ServerActionsTestJSON-server-840202433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-840202433',id=34,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-65dp0ch9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=4ce9811b-8c03-4a32-bfb0-5c9bc5867e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:22:44 user nova-compute[71689]:   <uuid>4ce9811b-8c03-4a32-bfb0-5c9bc5867e88</uuid>
Apr 14 17:22:44 user nova-compute[71689]:   <name>instance-00000022</name>
Apr 14 17:22:44 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:22:44 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:22:44 user nova-compute[71689]:   <metadata>
Apr 14 17:22:44 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:22:44 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:22:44 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-840202433</nova:name>
Apr 14 17:22:44 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:22:44</nova:creationTime>
Apr 14 17:22:44 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:22:44 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:22:44 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:22:44 user nova-compute[71689]:       <nova:owner>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:22:44 user nova-compute[71689]:       </nova:owner>
Apr 14 17:22:44 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:22:44 user nova-compute[71689]:       <nova:ports>
Apr 14 17:22:44 user nova-compute[71689]:         <nova:port uuid="ff6f2e44-8051-46b5-9b63-46b5fcc6db6a">
Apr 14 17:22:44 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 17:22:44 user nova-compute[71689]:         </nova:port>
Apr 14 17:22:44 user nova-compute[71689]:       </nova:ports>
Apr 14 17:22:44 user nova-compute[71689]:     </nova:instance>
Apr 14 17:22:44 user nova-compute[71689]:   </metadata>
Apr 14 17:22:44 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:22:44 user nova-compute[71689]:     <system>
Apr 14 17:22:44 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:22:44 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:22:44 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:22:44 user nova-compute[71689]:       <entry name="serial">4ce9811b-8c03-4a32-bfb0-5c9bc5867e88</entry>
Apr 14 17:22:44 user nova-compute[71689]:       <entry name="uuid">4ce9811b-8c03-4a32-bfb0-5c9bc5867e88</entry>
Apr 14 17:22:44 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:22:44 user nova-compute[71689]:     </system>
Apr 14 17:22:44 user nova-compute[71689]:   </sysinfo>
Apr 14 17:22:44 user nova-compute[71689]:   <os>
Apr 14 17:22:44 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:22:44 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:22:44 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:22:44 user nova-compute[71689]:   </os>
Apr 14 17:22:44 user nova-compute[71689]:   <features>
Apr 14 17:22:44 user nova-compute[71689]:     <acpi/>
Apr 14 17:22:44 user nova-compute[71689]:     <apic/>
Apr 14 17:22:44 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:22:44 user nova-compute[71689]:   </features>
Apr 14 17:22:44 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:22:44 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:22:44 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:22:44 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:22:44 user nova-compute[71689]:   </clock>
Apr 14 17:22:44 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:22:44 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:22:44 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:22:44 user nova-compute[71689]:   </cpu>
Apr 14 17:22:44 user nova-compute[71689]:   <devices>
Apr 14 17:22:44 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:22:44 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:22:44 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk"/>
Apr 14 17:22:44 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:22:44 user nova-compute[71689]:     </disk>
Apr 14 17:22:44 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:22:44 user nova-compute[71689]:       <mac address="fa:16:3e:0f:7a:22"/>
Apr 14 17:22:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:22:44 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:22:44 user nova-compute[71689]:       <target dev="tapff6f2e44-80"/>
Apr 14 17:22:44 user nova-compute[71689]:     </interface>
Apr 14 17:22:44 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:22:44 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/console.log" append="off"/>
Apr 14 17:22:44 user nova-compute[71689]:     </serial>
Apr 14 17:22:44 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:22:44 user nova-compute[71689]:     <video>
Apr 14 17:22:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:22:44 user nova-compute[71689]:     </video>
Apr 14 17:22:44 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:22:44 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:22:44 user nova-compute[71689]:     </rng>
Apr 14 17:22:44 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:22:44 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:22:44 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:22:44 user nova-compute[71689]:     </memballoon>
Apr 14 17:22:44 user nova-compute[71689]:   </devices>
Apr 14 17:22:44 user nova-compute[71689]: </domain>
Apr 14 17:22:44 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-840202433',display_name='tempest-ServerActionsTestJSON-server-840202433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-840202433',id=34,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-65dp0ch9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=4ce9811b-8c03-4a32-bfb0-5c9bc5867e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG os_vif [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff6f2e44-80, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff6f2e44-80, col_values=(('external_ids', {'iface-id': 'ff6f2e44-8051-46b5-9b63-46b5fcc6db6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:7a:22', 'vm-uuid': '4ce9811b-8c03-4a32-bfb0-5c9bc5867e88'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:44 user nova-compute[71689]: INFO os_vif [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80')
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:22:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:0f:7a:22, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HEncJGQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:22:45 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:22:45 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:22:45 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[665125d8-89d8-4970-bda0-4ea5ca179d21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:22:45 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf700b-e2e0-4af6-ad37-510391f371ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807] added
Apr 14 17:22:45 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[050eaf40-72ec-46da-a983-b0c6a9269baa]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] No waiting events found dispatching network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:22:45 user nova-compute[71689]: WARNING nova.compute.manager [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received unexpected event network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance with vm_state building and task_state spawning.
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b420940f-9dd1-4afc-bec7-6b77d53b3b6b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HEncJGQL {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HEncJGQL" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[587021d8-ec7f-4a9b-8e88-28418f9b8d43]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HEncJGQL'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce9c521-7616-4e83-9678-8531de8fdfe4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc581959-5537-4619-be27-06cb9473b80c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:45 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:45 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:45 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:45 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:45 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:45 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccee76b7-3cff-4d23-bc80-d42f72fa4338]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260]
Apr 14 17:22:45 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260] successful.
Apr 14 17:22:45 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a11af93-dac4-4a53-96bb-cb0af2c7ff29]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f4bc7-578b-4186-9afa-2b9c4f30d927]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 (non-flash)
Apr 14 17:22:46 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9808613-1b57-4491-8f2b-918b8edbda4a]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HEncJGQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23439393834306263', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439393834306263', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:22:47 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:22:47 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:22:47 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:22:47 user nova-compute[71689]:   <serial>a0e1588e-3447-4cc6-8740-d7a3b6af2807</serial>
Apr 14 17:22:47 user nova-compute[71689]: </disk>
Apr 14 17:22:47 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "b9628e25-8292-4b41-87dd-e6149a31f768" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:22:47 user nova-compute[71689]: INFO nova.compute.claims [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Claim successful on node user
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No VIF found with MAC fa:16:3e:d6:23:b6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.006s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:22:47 user nova-compute[71689]: INFO nova.compute.manager [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Terminating instance
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] No waiting events found dispatching network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:22:47 user nova-compute[71689]: WARNING nova.compute.manager [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received unexpected event network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance with vm_state building and task_state spawning.
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492967.937323, 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:22:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] VM Resumed (Lifecycle Event)
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:22:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Instance spawned successfully.
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492967.9416316, 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] VM Started (Lifecycle Event)
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.policy [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7daa9a32819e442e8c0713f128dbc827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42aeec65dc86431ba3a607e0c425f130', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Creating image(s)
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "/opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "/opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Took 6.80 seconds to spawn the instance on the hypervisor.
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.174s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.compute.manager [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Took 7.71 seconds to build instance.
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.826s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.174s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk 1073741824" returned: 0 in 0.051s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Instance destroyed successfully.
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'resources' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1126441201',display_name='tempest-TestMinimumBasicScenario-server-1126441201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1126441201',id=29,image_ref='8caa5797-8d3f-4f61-87c7-49659946e637',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBqCKExFDT4PvSC0/Uu1Any81coLdKotsFBCAghCyw66XGwNtKRqgQhOViH0z9vGTd8aHqH3bIsE+BRrOoCbXTCLZj1BZ5obFRwyyFzyqkP9hL4qq9+vfqA17m0cuNySw==',key_name='tempest-TestMinimumBasicScenario-1307984235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a92a4f922f442a88cfb86f8239e52ac',ramdisk_id='',reservation_id='r-a75c24e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8caa5797-8d3f-4f61-87c7-49659946e637',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1645387059',owner_user_name='tempest-TestMinimumBasicScenario-1645387059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:20:07Z,user_data=None,user_id='4bd0842f11b0499298e2af46ad659962',uuid=6a5ebe0f-81d3-4dbc-b55f-4c42d2857715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converting VIF {"id": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "address": "fa:16:3e:14:65:80", "network": {"id": "c5734dfe-c265-4d08-840a-4116e7574b53", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-803693508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a92a4f922f442a88cfb86f8239e52ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e76338-e6", "ovs_interfaceid": "43e76338-e6dd-456e-b1e2-d2f7c150f14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG os_vif [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.175s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43e76338-e6, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:22:48 user nova-compute[71689]: INFO os_vif [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:65:80,bridge_name='br-int',has_traffic_filtering=True,id=43e76338-e6dd-456e-b1e2-d2f7c150f14d,network=Network(c5734dfe-c265-4d08-840a-4116e7574b53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e76338-e6')
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Deleting instance files /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715_del
Apr 14 17:22:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Deletion of /opt/stack/data/nova/instances/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715_del complete
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Cannot resize image /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.objects.instance [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lazy-loading 'migration_context' on Instance uuid b9628e25-8292-4b41-87dd-e6149a31f768 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Ensure instance console log exists: /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Successfully created port: 8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:22:49 user nova-compute[71689]: INFO nova.compute.manager [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Took 1.49 seconds to destroy the instance on the hypervisor.
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-unplugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-unplugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-unplugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Acquiring lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.compute.manager [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] No waiting events found dispatching network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:22:49 user nova-compute[71689]: WARNING nova.compute.manager [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received unexpected event network-vif-plugged-43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance with vm_state active and task_state deleting.
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Successfully updated port: 8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "refresh_cache-b9628e25-8292-4b41-87dd-e6149a31f768" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquired lock "refresh_cache-b9628e25-8292-4b41-87dd-e6149a31f768" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:49 user nova-compute[71689]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-changed-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Refreshing instance network info cache due to event network-changed-8faddbf2-7a4e-4c78-856d-0d858d8b9cad. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Acquiring lock "refresh_cache-b9628e25-8292-4b41-87dd-e6149a31f768" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:22:50 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Took 0.79 seconds to deallocate network for instance.
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Received event network-vif-deleted-43e76338-e6dd-456e-b1e2-d2f7c150f14d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:50 user nova-compute[71689]: INFO nova.compute.manager [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Neutron deleted interface 43e76338-e6dd-456e-b1e2-d2f7c150f14d; detaching it from the instance and deleting it from the info cache
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.compute.manager [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Detach interface failed, port_id=43e76338-e6dd-456e-b1e2-d2f7c150f14d, reason: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Updating instance_info_cache with network_info: [{"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Releasing lock "refresh_cache-b9628e25-8292-4b41-87dd-e6149a31f768" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Instance network_info: |[{"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Acquired lock "refresh_cache-b9628e25-8292-4b41-87dd-e6149a31f768" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.neutron [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Refreshing network info cache for port 8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Start _get_guest_xml network_info=[{"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:22:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:22:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-349861328',display_name='tempest-VolumesActionsTest-instance-349861328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-349861328',id=35,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42aeec65dc86431ba3a607e0c425f130',ramdisk_id='',reservation_id='r-m1u557lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-241175421',owner_user_name='tempest-VolumesActionsTest-241175421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:22:48Z,user_data=None,user_id='7daa9a32819e442e8c0713f128dbc827',uuid=b9628e25-8292-4b41-87dd-e6149a31f768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Converting VIF {"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lazy-loading 'pci_devices' on Instance uuid b9628e25-8292-4b41-87dd-e6149a31f768 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:22:50 user nova-compute[71689]:   <uuid>b9628e25-8292-4b41-87dd-e6149a31f768</uuid>
Apr 14 17:22:50 user nova-compute[71689]:   <name>instance-00000023</name>
Apr 14 17:22:50 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:22:50 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:22:50 user nova-compute[71689]:   <metadata>
Apr 14 17:22:50 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:22:50 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:22:50 user nova-compute[71689]:       <nova:name>tempest-VolumesActionsTest-instance-349861328</nova:name>
Apr 14 17:22:50 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:22:50</nova:creationTime>
Apr 14 17:22:50 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:22:50 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:22:50 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:22:50 user nova-compute[71689]:       <nova:owner>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:user uuid="7daa9a32819e442e8c0713f128dbc827">tempest-VolumesActionsTest-241175421-project-member</nova:user>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:project uuid="42aeec65dc86431ba3a607e0c425f130">tempest-VolumesActionsTest-241175421</nova:project>
Apr 14 17:22:50 user nova-compute[71689]:       </nova:owner>
Apr 14 17:22:50 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:22:50 user nova-compute[71689]:       <nova:ports>
Apr 14 17:22:50 user nova-compute[71689]:         <nova:port uuid="8faddbf2-7a4e-4c78-856d-0d858d8b9cad">
Apr 14 17:22:50 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:22:50 user nova-compute[71689]:         </nova:port>
Apr 14 17:22:50 user nova-compute[71689]:       </nova:ports>
Apr 14 17:22:50 user nova-compute[71689]:     </nova:instance>
Apr 14 17:22:50 user nova-compute[71689]:   </metadata>
Apr 14 17:22:50 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:22:50 user nova-compute[71689]:     <system>
Apr 14 17:22:50 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:22:50 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:22:50 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:22:50 user nova-compute[71689]:       <entry name="serial">b9628e25-8292-4b41-87dd-e6149a31f768</entry>
Apr 14 17:22:50 user nova-compute[71689]:       <entry name="uuid">b9628e25-8292-4b41-87dd-e6149a31f768</entry>
Apr 14 17:22:50 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:22:50 user nova-compute[71689]:     </system>
Apr 14 17:22:50 user nova-compute[71689]:   </sysinfo>
Apr 14 17:22:50 user nova-compute[71689]:   <os>
Apr 14 17:22:50 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:22:50 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:22:50 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:22:50 user nova-compute[71689]:   </os>
Apr 14 17:22:50 user nova-compute[71689]:   <features>
Apr 14 17:22:50 user nova-compute[71689]:     <acpi/>
Apr 14 17:22:50 user nova-compute[71689]:     <apic/>
Apr 14 17:22:50 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:22:50 user nova-compute[71689]:   </features>
Apr 14 17:22:50 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:22:50 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:22:50 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:22:50 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:22:50 user nova-compute[71689]:   </clock>
Apr 14 17:22:50 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:22:50 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:22:50 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:22:50 user nova-compute[71689]:   </cpu>
Apr 14 17:22:50 user nova-compute[71689]:   <devices>
Apr 14 17:22:50 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:22:50 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:22:50 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk"/>
Apr 14 17:22:50 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:22:50 user nova-compute[71689]:     </disk>
Apr 14 17:22:50 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:22:50 user nova-compute[71689]:       <mac address="fa:16:3e:7d:8f:4d"/>
Apr 14 17:22:50 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:22:50 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:22:50 user nova-compute[71689]:       <target dev="tap8faddbf2-7a"/>
Apr 14 17:22:50 user nova-compute[71689]:     </interface>
Apr 14 17:22:50 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:22:50 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/console.log" append="off"/>
Apr 14 17:22:50 user nova-compute[71689]:     </serial>
Apr 14 17:22:50 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:22:50 user nova-compute[71689]:     <video>
Apr 14 17:22:50 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:22:50 user nova-compute[71689]:     </video>
Apr 14 17:22:50 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:22:50 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:22:50 user nova-compute[71689]:     </rng>
Apr 14 17:22:50 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:22:50 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:22:50 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:22:50 user nova-compute[71689]:     </memballoon>
Apr 14 17:22:50 user nova-compute[71689]:   </devices>
Apr 14 17:22:50 user nova-compute[71689]: </domain>
Apr 14 17:22:50 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-349861328',display_name='tempest-VolumesActionsTest-instance-349861328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-349861328',id=35,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42aeec65dc86431ba3a607e0c425f130',ramdisk_id='',reservation_id='r-m1u557lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-241175421',owner_user_name='tempest-VolumesActionsTest-241175421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:22:48Z,user_data=None,user_id='7daa9a32819e442e8c0713f128dbc827',uuid=b9628e25-8292-4b41-87dd-e6149a31f768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Converting VIF {"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG os_vif [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8faddbf2-7a, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8faddbf2-7a, col_values=(('external_ids', {'iface-id': '8faddbf2-7a4e-4c78-856d-0d858d8b9cad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:8f:4d', 'vm-uuid': 'b9628e25-8292-4b41-87dd-e6149a31f768'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:50 user nova-compute[71689]: INFO os_vif [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a')
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] No VIF found with MAC fa:16:3e:7d:8f:4d, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:50 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Deleted allocations for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715
Apr 14 17:22:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.077s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Updated VIF entry in instance network info cache for port 8faddbf2-7a4e-4c78-856d-0d858d8b9cad. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:22:51 user nova-compute[71689]: DEBUG nova.network.neutron [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Updating instance_info_cache with network_info: [{"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:22:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Releasing lock "refresh_cache-b9628e25-8292-4b41-87dd-e6149a31f768" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] No waiting events found dispatching network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:22:52 user nova-compute[71689]: WARNING nova.compute.manager [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received unexpected event network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance with vm_state building and task_state spawning.
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492974.283072, b9628e25-8292-4b41-87dd-e6149a31f768 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] VM Resumed (Lifecycle Event)
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Instance spawned successfully.
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492974.2841883, b9628e25-8292-4b41-87dd-e6149a31f768 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] VM Started (Lifecycle Event)
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Took 6.34 seconds to spawn the instance on the hypervisor.
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] No waiting events found dispatching network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:22:54 user nova-compute[71689]: WARNING nova.compute.manager [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received unexpected event network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance with vm_state building and task_state spawning.
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:22:54 user nova-compute[71689]: INFO nova.compute.manager [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Took 7.34 seconds to build instance.
Apr 14 17:22:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "b9628e25-8292-4b41-87dd-e6149a31f768" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:22:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:22:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:00 user nova-compute[71689]: INFO nova.compute.manager [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Detaching volume a0e1588e-3447-4cc6-8740-d7a3b6af2807
Apr 14 17:23:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:00 user nova-compute[71689]: INFO nova.virt.block_device [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attempting to driver detach volume a0e1588e-3447-4cc6-8740-d7a3b6af2807 from mountpoint /dev/vdb
Apr 14 17:23:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Attempting to detach device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:23:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:23:00 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:23:00 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:23:00 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:23:00 user nova-compute[71689]:   <serial>a0e1588e-3447-4cc6-8740-d7a3b6af2807</serial>
Apr 14 17:23:00 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:23:00 user nova-compute[71689]: </disk>
Apr 14 17:23:00 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:23:00 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config.
Apr 14 17:23:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:23:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:23:00 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:23:00 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:23:00 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:23:00 user nova-compute[71689]:   <serial>a0e1588e-3447-4cc6-8740-d7a3b6af2807</serial>
Apr 14 17:23:00 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:23:00 user nova-compute[71689]: </disk>
Apr 14 17:23:00 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681492981.0335379, 15ce59e7-b263-4e0b-9f19-638db9606c7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:23:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config.
Apr 14 17:23:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HEncJGQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:23:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd16497-1a22-4cd2-8761-7a1640fdff8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:23:01 user nova-compute[71689]: No targets found.
Apr 14 17:23:01 user nova-compute[71689]: iSNS:
Apr 14 17:23:01 user nova-compute[71689]: No targets found.
Apr 14 17:23:01 user nova-compute[71689]: STATIC:
Apr 14 17:23:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:23:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:23:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:23:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807
Apr 14 17:23:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:23:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:23:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:23:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:23:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:23:01 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:23:01 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:23:01 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:23:01 user nova-compute[71689]: FIRMWARE:
Apr 14 17:23:01 user nova-compute[71689]: No targets found.
Apr 14 17:23:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:23:01 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:23:01 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87345022-07f0-4964-90a6-5f80b23dd144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701bdef-e5fd-4f0f-b170-f2b184945171]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 (non-flash)
Apr 14 17:23:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b3c23cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c37ed-195d-4c2e-b9e4-115a0852b691]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c05b3b-f665-401a-84b4-71cb491fb1e4]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc38e9-35b9-4af0-bf49-bbbd8b490473]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a316bd-6564-4f9d-8ad6-95e3f2ec0260]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e2e3c-e313-4ba2-970d-7a6a536ccb1e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aea0fd-04b5-4204-ab1c-a43d7f8cea63]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260]
Apr 14 17:23:01 user nova-compute[71689]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807, portal: 172.16.0.220,3260] successful.
Apr 14 17:23:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e1588e-3447-4cc6-8740-d7a3b6af2807 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d587bd-ea36-4a80-ba53-d7e285207c81]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== disconnect_volume: return (315ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:23:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:23:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:23:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.964s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:03 user nova-compute[71689]: INFO nova.compute.manager [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Unrescuing
Apr 14 17:23:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquired lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681492968.5906174, 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:03 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] VM Stopped (Lifecycle Event)
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aac5db92-978a-48dd-a6f0-4ffb0b9b2276 None None] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updating instance_info_cache with network_info: [{"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Releasing lock "refresh_cache-99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.objects.instance [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'flavor' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:03 user nova-compute[71689]: WARNING nova.compute.manager [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:23:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:04 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance destroyed successfully.
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:06 user nova-compute[71689]: WARNING nova.compute.manager [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:23:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:06 user nova-compute[71689]: WARNING nova.compute.manager [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492987.7862504, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:07 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Resumed (Lifecycle Event)
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:23:07 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492987.7878895, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:07 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Started (Lifecycle Event)
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:23:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:08 user nova-compute[71689]: DEBUG nova.compute.manager [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:08 user nova-compute[71689]: WARNING nova.compute.manager [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state None.
Apr 14 17:23:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:10 user nova-compute[71689]: INFO nova.compute.manager [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Unrescuing
Apr 14 17:23:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:23:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:23:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:23:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:10 user nova-compute[71689]: DEBUG nova.network.neutron [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:23:10 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:23:10 user nova-compute[71689]: DEBUG nova.objects.instance [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:11 user nova-compute[71689]: DEBUG nova.compute.manager [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:11 user nova-compute[71689]: WARNING nova.compute.manager [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:23:11 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance destroyed successfully.
Apr 14 17:23:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:13 user nova-compute[71689]: INFO nova.compute.manager [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] instance snapshotting
Apr 14 17:23:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Beginning live snapshot process
Apr 14 17:23:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:13 user nova-compute[71689]: WARNING nova.compute.manager [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:23:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:13 user nova-compute[71689]: WARNING nova.compute.manager [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state rescued and task_state unrescuing.
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json -f qcow2 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsqm28no8/4f0780d1f5024008832eb31f32c7d478.delta 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsqm28no8/4f0780d1f5024008832eb31f32c7d478.delta 1073741824" returned: 0 in 0.047s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 17:23:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 0cf7a0ce-87a0-4a24-8410-26d056e8816c due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492995.078562, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:15 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Resumed (Lifecycle Event)
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:15 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681492995.0807092, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:15 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Started (Lifecycle Event)
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71689) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 17:23:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsqm28no8/4f0780d1f5024008832eb31f32c7d478.delta /opt/stack/data/nova/instances/snapshots/tmpsqm28no8/4f0780d1f5024008832eb31f32c7d478 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:15 user nova-compute[71689]: WARNING nova.compute.manager [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state active and task_state None.
Apr 14 17:23:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsqm28no8/4f0780d1f5024008832eb31f32c7d478.delta /opt/stack/data/nova/instances/snapshots/tmpsqm28no8/4f0780d1f5024008832eb31f32c7d478" returned: 0 in 0.236s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Snapshot extracted, beginning image upload
Apr 14 17:23:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Snapshot image upload complete
Apr 14 17:23:17 user nova-compute[71689]: INFO nova.compute.manager [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Took 4.59 seconds to snapshot the instance on the hypervisor.
Apr 14 17:23:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:23:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:23:23 user nova-compute[71689]: INFO nova.compute.claims [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Claim successful on node user
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:23:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.policy [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:23:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Creating image(s)
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "/opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "/opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "5580342fa92939d1afbe3b8b16c1f7801cc8c7ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "5580342fa92939d1afbe3b8b16c1f7801cc8c7ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.part --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.part --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.virt.images [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] b82a7509-0a29-4cd7-84f4-661d4214f0b1 was qcow2, converting to raw {{(pid=71689) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.privsep.utils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71689) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.part /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.converted {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Successfully created port: 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.part /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.converted" returned: 0 in 0.312s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.converted --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "5580342fa92939d1afbe3b8b16c1f7801cc8c7ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.196s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "5580342fa92939d1afbe3b8b16c1f7801cc8c7ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "5580342fa92939d1afbe3b8b16c1f7801cc8c7ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed,backing_fmt=raw /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed,backing_fmt=raw /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk 1073741824" returned: 0 in 0.047s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "5580342fa92939d1afbe3b8b16c1f7801cc8c7ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Successfully updated port: 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquired lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.objects.instance [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'migration_context' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-changed-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Refreshing instance network info cache due to event network-changed-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Acquiring lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Ensure instance console log exists: /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updating instance_info_cache with network_info: [{"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Releasing lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Instance network_info: |[{"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Acquired lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Refreshing network info cache for port 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Start _get_guest_xml network_info=[{"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='78a72da01370380c4ba73b9d40683fed',container_format='bare',created_at=2023-04-14T17:23:13Z,direct_url=<?>,disk_format='qcow2',id=b82a7509-0a29-4cd7-84f4-661d4214f0b1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2010281861',owner='f7ab08f97dd54832a7cc975934b1b69f',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T17:23:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b82a7509-0a29-4cd7-84f4-661d4214f0b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:23:26 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:23:26 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='78a72da01370380c4ba73b9d40683fed',container_format='bare',created_at=2023-04-14T17:23:13Z,direct_url=<?>,disk_format='qcow2',id=b82a7509-0a29-4cd7-84f4-661d4214f0b1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2010281861',owner='f7ab08f97dd54832a7cc975934b1b69f',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T17:23:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1710972168',display_name='tempest-TestStampPattern-server-1710972168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1710972168',id=36,image_ref='b82a7509-0a29-4cd7-84f4-661d4214f0b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA==',key_name='tempest-TestStampPattern-1893968129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ab08f97dd54832a7cc975934b1b69f',ramdisk_id='',reservation_id='r-aco4xyaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='15a48598-5e5d-450b-a6c5-d7637a6d8682',image_min_disk='1',image_min_ram='0',image_owner_id='f7ab08f97dd54832a7cc975934b1b69f',image_owner_project_name='tempest-TestStampPattern-872060463',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-872060463-project-member',image_user_id='b8ea39d187c842788168909de203455e',network_allocated='True',owner_project_name='tempest-TestStampPattern-872060463',owner_user_name='tempest-TestStampPattern-872060463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:23:24Z,user_data=None,user_id='b8ea39d187c842788168909de203455e',uuid=f1607fec-229c-4bce-b9d4-b8b01a650859,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converting VIF {"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.objects.instance [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'pci_devices' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:23:26 user nova-compute[71689]:   <uuid>f1607fec-229c-4bce-b9d4-b8b01a650859</uuid>
Apr 14 17:23:26 user nova-compute[71689]:   <name>instance-00000024</name>
Apr 14 17:23:26 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:23:26 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:23:26 user nova-compute[71689]:   <metadata>
Apr 14 17:23:26 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:23:26 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:23:26 user nova-compute[71689]:       <nova:name>tempest-TestStampPattern-server-1710972168</nova:name>
Apr 14 17:23:26 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:23:26</nova:creationTime>
Apr 14 17:23:26 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:23:26 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:23:26 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:23:26 user nova-compute[71689]:       <nova:owner>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:user uuid="b8ea39d187c842788168909de203455e">tempest-TestStampPattern-872060463-project-member</nova:user>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:project uuid="f7ab08f97dd54832a7cc975934b1b69f">tempest-TestStampPattern-872060463</nova:project>
Apr 14 17:23:26 user nova-compute[71689]:       </nova:owner>
Apr 14 17:23:26 user nova-compute[71689]:       <nova:root type="image" uuid="b82a7509-0a29-4cd7-84f4-661d4214f0b1"/>
Apr 14 17:23:26 user nova-compute[71689]:       <nova:ports>
Apr 14 17:23:26 user nova-compute[71689]:         <nova:port uuid="5d23bb5b-a645-4a30-9fcf-177b0bfd64f5">
Apr 14 17:23:26 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:23:26 user nova-compute[71689]:         </nova:port>
Apr 14 17:23:26 user nova-compute[71689]:       </nova:ports>
Apr 14 17:23:26 user nova-compute[71689]:     </nova:instance>
Apr 14 17:23:26 user nova-compute[71689]:   </metadata>
Apr 14 17:23:26 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:23:26 user nova-compute[71689]:     <system>
Apr 14 17:23:26 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:23:26 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:23:26 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:23:26 user nova-compute[71689]:       <entry name="serial">f1607fec-229c-4bce-b9d4-b8b01a650859</entry>
Apr 14 17:23:26 user nova-compute[71689]:       <entry name="uuid">f1607fec-229c-4bce-b9d4-b8b01a650859</entry>
Apr 14 17:23:26 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:23:26 user nova-compute[71689]:     </system>
Apr 14 17:23:26 user nova-compute[71689]:   </sysinfo>
Apr 14 17:23:26 user nova-compute[71689]:   <os>
Apr 14 17:23:26 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:23:26 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:23:26 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:23:26 user nova-compute[71689]:   </os>
Apr 14 17:23:26 user nova-compute[71689]:   <features>
Apr 14 17:23:26 user nova-compute[71689]:     <acpi/>
Apr 14 17:23:26 user nova-compute[71689]:     <apic/>
Apr 14 17:23:26 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:23:26 user nova-compute[71689]:   </features>
Apr 14 17:23:26 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:23:26 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:23:26 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:23:26 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:23:26 user nova-compute[71689]:   </clock>
Apr 14 17:23:26 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:23:26 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:23:26 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:23:26 user nova-compute[71689]:   </cpu>
Apr 14 17:23:26 user nova-compute[71689]:   <devices>
Apr 14 17:23:26 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:23:26 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:23:26 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk"/>
Apr 14 17:23:26 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:23:26 user nova-compute[71689]:     </disk>
Apr 14 17:23:26 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:23:26 user nova-compute[71689]:       <mac address="fa:16:3e:e7:22:7c"/>
Apr 14 17:23:26 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:23:26 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:23:26 user nova-compute[71689]:       <target dev="tap5d23bb5b-a6"/>
Apr 14 17:23:26 user nova-compute[71689]:     </interface>
Apr 14 17:23:26 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:23:26 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/console.log" append="off"/>
Apr 14 17:23:26 user nova-compute[71689]:     </serial>
Apr 14 17:23:26 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:23:26 user nova-compute[71689]:     <video>
Apr 14 17:23:26 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:23:26 user nova-compute[71689]:     </video>
Apr 14 17:23:26 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:23:26 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:23:26 user nova-compute[71689]:     </rng>
Apr 14 17:23:26 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:23:26 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:23:26 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:23:26 user nova-compute[71689]:     </memballoon>
Apr 14 17:23:26 user nova-compute[71689]:   </devices>
Apr 14 17:23:26 user nova-compute[71689]: </domain>
Apr 14 17:23:26 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1710972168',display_name='tempest-TestStampPattern-server-1710972168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1710972168',id=36,image_ref='b82a7509-0a29-4cd7-84f4-661d4214f0b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA==',key_name='tempest-TestStampPattern-1893968129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ab08f97dd54832a7cc975934b1b69f',ramdisk_id='',reservation_id='r-aco4xyaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='15a48598-5e5d-450b-a6c5-d7637a6d8682',image_min_disk='1',image_min_ram='0',image_owner_id='f7ab08f97dd54832a7cc975934b1b69f',image_owner_project_name='tempest-TestStampPattern-872060463',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-872060463-project-member',image_user_id='b8ea39d187c842788168909de203455e',network_allocated='True',owner_project_name='tempest-TestStampPattern-872060463',owner_user_name='tempest-TestStampPattern-872060463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:23:24Z,user_data=None,user_id='b8ea39d187c842788168909de203455e',uuid=f1607fec-229c-4bce-b9d4-b8b01a650859,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converting VIF {"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG os_vif [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d23bb5b-a6, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d23bb5b-a6, col_values=(('external_ids', {'iface-id': '5d23bb5b-a645-4a30-9fcf-177b0bfd64f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:22:7c', 'vm-uuid': 'f1607fec-229c-4bce-b9d4-b8b01a650859'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:26 user nova-compute[71689]: INFO os_vif [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6')
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No VIF found with MAC fa:16:3e:e7:22:7c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updated VIF entry in instance network info cache for port 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updating instance_info_cache with network_info: [{"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:23:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Releasing lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] No waiting events found dispatching network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:27 user nova-compute[71689]: WARNING nova.compute.manager [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received unexpected event network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance with vm_state building and task_state spawning.
Apr 14 17:23:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [{"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-a075e35f-c43c-4e3a-adb2-2e1629079d93" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493009.8905072, f1607fec-229c-4bce-b9d4-b8b01a650859 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] VM Resumed (Lifecycle Event)
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:23:29 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Instance spawned successfully.
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:23:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493009.8918304, f1607fec-229c-4bce-b9d4-b8b01a650859 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:23:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] VM Started (Lifecycle Event)
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:23:29 user nova-compute[71689]: INFO nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 14 17:23:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:23:29 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:23:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:23:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] No waiting events found dispatching network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:23:30 user nova-compute[71689]: WARNING nova.compute.manager [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received unexpected event network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance with vm_state building and task_state spawning.
Apr 14 17:23:30 user nova-compute[71689]: INFO nova.compute.manager [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Took 6.48 seconds to build instance.
Apr 14 17:23:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.584s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:23:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:38 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:23:38 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7453MB free_disk=25.874549865722656GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance b9628e25-8292-4b41-87dd-e6149a31f768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f1607fec-229c-4bce-b9d4-b8b01a650859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:23:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:23:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG nova.objects.instance [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:23:54 user nova-compute[71689]: INFO nova.compute.manager [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attaching volume e828e55a-f155-442c-a964-8c7037b11c3f to /dev/vdb
Apr 14 17:23:54 user nova-compute[71689]: DEBUG os_brick.utils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f43a0-593e-457a-9f4b-74d438f5b6ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c319b-0cc5-47f4-be8c-c2c702deb134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c1d0e-d4d5-43c8-b940-7429c9080d80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff5250-b9ae-4e36-a700-32e73a7ba318]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:23:54 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:23:54 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ea156b-90e6-4d82-bf18-3ea36b00ae0e]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG os_brick.utils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:23:54 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating existing volume attachment record: 9627d7c5-53a8-4eec-b04a-5218d8bc04c9 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:23:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKRxsPfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:23:59 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:23:59 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:23:59 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfb652f-b2f7-4e08-9e2c-b3f75569c841]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:23:59 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28012df-a040-496d-b8a1-811d091a1949]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f] added
Apr 14 17:23:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6dfc72-5cc4-40c1-b1a6-152190cf5103]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[108612bf-30b6-43bb-8784-c71b364e6965]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKRxsPfM {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKRxsPfM" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d17c77b-726a-44fd-9d67-052aa9899a84]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKRxsPfM'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0963ca90-b182-4276-8bb9-c38c76e65142]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e52e3ea-1845-4ac3-9161-44192ec400f8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[132a7dd3-4787-4bdb-b931-6d7fb575e0e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260]
Apr 14 17:23:59 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260] successful.
Apr 14 17:23:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac0cfe-d75a-421e-8998-c5f22477d67e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d7fab9-05f0-45ee-baaa-39a3a5e5fdbf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f (non-flash)
Apr 14 17:23:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:23:59 user nova-compute[71689]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f (non-flash)
Apr 14 17:23:59 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a3446-a544-44c6-b57d-042e31543158]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:23:59 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKRxsPfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23331633065393739', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331633065393739', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG nova.objects.instance [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:24:00 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:24:00 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:24:00 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:24:00 user nova-compute[71689]:   <serial>e828e55a-f155-442c-a964-8c7037b11c3f</serial>
Apr 14 17:24:00 user nova-compute[71689]: </disk>
Apr 14 17:24:00 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:24:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No VIF found with MAC fa:16:3e:d6:23:b6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:24:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.634s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:02 user nova-compute[71689]: INFO nova.compute.manager [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Detaching volume e828e55a-f155-442c-a964-8c7037b11c3f
Apr 14 17:24:02 user nova-compute[71689]: INFO nova.virt.block_device [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attempting to driver detach volume e828e55a-f155-442c-a964-8c7037b11c3f from mountpoint /dev/vdb
Apr 14 17:24:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Attempting to detach device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:24:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:24:02 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:24:02 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:24:02 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:24:02 user nova-compute[71689]:   <serial>e828e55a-f155-442c-a964-8c7037b11c3f</serial>
Apr 14 17:24:02 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:24:02 user nova-compute[71689]: </disk>
Apr 14 17:24:02 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:24:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config.
Apr 14 17:24:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:24:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:24:02 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:24:02 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:24:02 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:24:02 user nova-compute[71689]:   <serial>e828e55a-f155-442c-a964-8c7037b11c3f</serial>
Apr 14 17:24:02 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:24:02 user nova-compute[71689]: </disk>
Apr 14 17:24:02 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493043.119675, 15ce59e7-b263-4e0b-9f19-638db9606c7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:24:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config.
Apr 14 17:24:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKRxsPfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:24:03 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c85b2-bc30-4746-8287-6ad9d3dcc58f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:24:03 user nova-compute[71689]: No targets found.
Apr 14 17:24:03 user nova-compute[71689]: iSNS:
Apr 14 17:24:03 user nova-compute[71689]: No targets found.
Apr 14 17:24:03 user nova-compute[71689]: STATIC:
Apr 14 17:24:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f
Apr 14 17:24:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:24:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:24:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:24:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:03 user nova-compute[71689]: FIRMWARE:
Apr 14 17:24:03 user nova-compute[71689]: No targets found.
Apr 14 17:24:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:24:03 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:24:03 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ae6e16-24cc-478f-bc84-bfc3c84674c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[361676ac-9410-45b4-a444-33e87fb6fdf4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:03 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:03 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:03 user nova-compute[71689]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f (non-flash)
Apr 14 17:24:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:03 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:03 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:03 user nova-compute[71689]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f (non-flash)
Apr 14 17:24:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c13dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5559aa-9208-4eb8-810e-be103fd8a0f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[01353837-d135-456e-9616-5b374624adcd]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92fba65-b805-4a16-b2a4-dc5f98bec429]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5eaf27-5964-4b10-b610-3e24a0f53af0]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790266e-ad1c-4e62-9da6-8958f96363e1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d44f9-724d-45c2-b4eb-e8ae6de04428]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260]
Apr 14 17:24:03 user nova-compute[71689]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f, portal: 172.16.0.220,3260] successful.
Apr 14 17:24:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e828e55a-f155-442c-a964-8c7037b11c3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61f41ad-4a20-48e2-b09c-0647df98dfad]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== disconnect_volume: return (296ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:24:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:24:04 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:24:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.563s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [{"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-5c01d750-5923-4b61-9f3a-17cf1142f0a5" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-changed-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Refreshing instance network info cache due to event network-changed-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Acquiring lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Acquired lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:24:31 user nova-compute[71689]: DEBUG nova.network.neutron [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Refreshing network info cache for port ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:24:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updated VIF entry in instance network info cache for port ff6f2e44-8051-46b5-9b63-46b5fcc6db6a. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:24:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:24:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Releasing lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:24:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.388s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:35 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "66599df0-d961-404f-9573-fe0289019752" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:24:37 user nova-compute[71689]: INFO nova.compute.claims [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Claim successful on node user
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:38 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:24:38 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7603MB free_disk=25.902122497558594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.027s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.103s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:24:38 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance b9628e25-8292-4b41-87dd-e6149a31f768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f1607fec-229c-4bce-b9d4-b8b01a650859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:24:38 user nova-compute[71689]: INFO nova.virt.block_device [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Booting with volume 6f629cce-a595-45d8-9afe-0f617ea75a87 at /dev/vda
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.policy [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG os_brick.utils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a030ebf-af3d-458e-9ef3-2c730a1ecf6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a48c750-6db8-4052-ac57-60aa8b44a906]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b939b1f-a604-4dc6-81fe-47dc58bee8cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ecc2e0-dc0c-4094-8471-12022f366bd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:24:38 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:24:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1cad96-2805-476d-9154-fa12cefd224a]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG os_brick.utils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:24:38 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating existing volume attachment record: 5fb10794-95b2-4bf2-b394-ff56afbce7d8 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:24:39 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:24:39 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:24:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:24:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Successfully created port: b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Successfully updated port: b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-changed-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Refreshing instance network info cache due to event network-changed-b85a290c-1e7e-4f74-8590-be96f453decf. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance network_info: |[{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:24:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Refreshing network info cache for port b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:24:41 user nova-compute[71689]: DEBUG nova.network.neutron [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Updated VIF entry in instance network info cache for port b85a290c-1e7e-4f74-8590-be96f453decf. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:24:41 user nova-compute[71689]: DEBUG nova.network.neutron [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:24:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:24:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:24:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Creating image(s)
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Ensure instance console log exists: /opt/stack/data/nova/instances/66599df0-d961-404f-9573-fe0289019752/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Start _get_guest_xml network_info=[{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66599df0-d961-404f-9573-fe0289019752', 'attached_at': '', 'detached_at': '', 'volume_id': '6f629cce-a595-45d8-9afe-0f617ea75a87', 'serial': '6f629cce-a595-45d8-9afe-0f617ea75a87'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '5fb10794-95b2-4bf2-b394-ff56afbce7d8', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:24:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:24:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:24:43 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:24:43 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:24:43 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[af87eb0b-92ca-4b61-8a7a-eab23bb50fa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:24:43 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea0944a-ece2-4117-9e7b-43b82d98a893]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87] added
Apr 14 17:24:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647bdda-1147-41e2-8257-cd77453ab4c4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff783bc-83d9-4f16-b616-d95c42131ac0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxqGBiVm {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxqGBiVm" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[40009d32-40d7-4f8a-a408-bb528f6f4173]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WxqGBiVm'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d628c9aa-1498-4cc3-9638-755d152b132c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c71639-a4a0-4596-8243-856c5ef6f9ea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:43 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:43 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:43 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:43 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:24:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a78691-efbc-447c-867e-94581381e251]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]
Apr 14 17:24:44 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.
Apr 14 17:24:44 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a998097-c8c4-46e3-b9f9-9187469b8ae1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f06c86f-a50d-4b2b-97d0-2c49f61448f6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:24:44 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b28ab9-f410-48ac-a97d-af7a424152ef]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "b9628e25-8292-4b41-87dd-e6149a31f768" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:44 user nova-compute[71689]: INFO nova.compute.manager [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Terminating instance
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-vif-unplugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] No waiting events found dispatching network-vif-unplugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-vif-unplugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Instance destroyed successfully.
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lazy-loading 'resources' on Instance uuid b9628e25-8292-4b41-87dd-e6149a31f768 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-349861328',display_name='tempest-VolumesActionsTest-instance-349861328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-349861328',id=35,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42aeec65dc86431ba3a607e0c425f130',ramdisk_id='',reservation_id='r-m1u557lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-241175421',owner_user_name='tempest-VolumesActionsTest-241175421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:22:54Z,user_data=None,user_id='7daa9a32819e442e8c0713f128dbc827',uuid=b9628e25-8292-4b41-87dd-e6149a31f768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Converting VIF {"id": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "address": "fa:16:3e:7d:8f:4d", "network": {"id": "437e4b37-0441-4e16-8f44-0e61729d4718", "bridge": "br-int", "label": "tempest-VolumesActionsTest-278909176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "42aeec65dc86431ba3a607e0c425f130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8faddbf2-7a", "ovs_interfaceid": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG os_vif [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8faddbf2-7a, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:44 user nova-compute[71689]: INFO os_vif [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:8f:4d,bridge_name='br-int',has_traffic_filtering=True,id=8faddbf2-7a4e-4c78-856d-0d858d8b9cad,network=Network(437e4b37-0441-4e16-8f44-0e61729d4718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8faddbf2-7a')
Apr 14 17:24:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Deleting instance files /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768_del
Apr 14 17:24:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Deletion of /opt/stack/data/nova/instances/b9628e25-8292-4b41-87dd-e6149a31f768_del complete
Apr 14 17:24:44 user nova-compute[71689]: INFO nova.compute.manager [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 14 17:24:44 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:24:44 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23131383339393137', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131383339393137', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1884229091',display_name='tempest-ServerActionsTestJSON-server-1884229091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1884229091',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-hy00qi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=66599df0-d961-404f-9573-fe0289019752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.objects.instance [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_devices' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:24:45 user nova-compute[71689]:   <uuid>66599df0-d961-404f-9573-fe0289019752</uuid>
Apr 14 17:24:45 user nova-compute[71689]:   <name>instance-00000025</name>
Apr 14 17:24:45 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:24:45 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:24:45 user nova-compute[71689]:   <metadata>
Apr 14 17:24:45 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:24:45 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:24:45 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-1884229091</nova:name>
Apr 14 17:24:45 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:24:43</nova:creationTime>
Apr 14 17:24:45 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:24:45 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:24:45 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:24:45 user nova-compute[71689]:       <nova:owner>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:24:45 user nova-compute[71689]:       </nova:owner>
Apr 14 17:24:45 user nova-compute[71689]:       <nova:ports>
Apr 14 17:24:45 user nova-compute[71689]:         <nova:port uuid="b85a290c-1e7e-4f74-8590-be96f453decf">
Apr 14 17:24:45 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:24:45 user nova-compute[71689]:         </nova:port>
Apr 14 17:24:45 user nova-compute[71689]:       </nova:ports>
Apr 14 17:24:45 user nova-compute[71689]:     </nova:instance>
Apr 14 17:24:45 user nova-compute[71689]:   </metadata>
Apr 14 17:24:45 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:24:45 user nova-compute[71689]:     <system>
Apr 14 17:24:45 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:24:45 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:24:45 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:24:45 user nova-compute[71689]:       <entry name="serial">66599df0-d961-404f-9573-fe0289019752</entry>
Apr 14 17:24:45 user nova-compute[71689]:       <entry name="uuid">66599df0-d961-404f-9573-fe0289019752</entry>
Apr 14 17:24:45 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:24:45 user nova-compute[71689]:     </system>
Apr 14 17:24:45 user nova-compute[71689]:   </sysinfo>
Apr 14 17:24:45 user nova-compute[71689]:   <os>
Apr 14 17:24:45 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:24:45 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:24:45 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:24:45 user nova-compute[71689]:   </os>
Apr 14 17:24:45 user nova-compute[71689]:   <features>
Apr 14 17:24:45 user nova-compute[71689]:     <acpi/>
Apr 14 17:24:45 user nova-compute[71689]:     <apic/>
Apr 14 17:24:45 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:24:45 user nova-compute[71689]:   </features>
Apr 14 17:24:45 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:24:45 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:24:45 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:24:45 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:24:45 user nova-compute[71689]:   </clock>
Apr 14 17:24:45 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:24:45 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:24:45 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:24:45 user nova-compute[71689]:   </cpu>
Apr 14 17:24:45 user nova-compute[71689]:   <devices>
Apr 14 17:24:45 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:24:45 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:24:45 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:24:45 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:24:45 user nova-compute[71689]:       <serial>6f629cce-a595-45d8-9afe-0f617ea75a87</serial>
Apr 14 17:24:45 user nova-compute[71689]:     </disk>
Apr 14 17:24:45 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:24:45 user nova-compute[71689]:       <mac address="fa:16:3e:95:4c:87"/>
Apr 14 17:24:45 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:24:45 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:24:45 user nova-compute[71689]:       <target dev="tapb85a290c-1e"/>
Apr 14 17:24:45 user nova-compute[71689]:     </interface>
Apr 14 17:24:45 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:24:45 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/66599df0-d961-404f-9573-fe0289019752/console.log" append="off"/>
Apr 14 17:24:45 user nova-compute[71689]:     </serial>
Apr 14 17:24:45 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:24:45 user nova-compute[71689]:     <video>
Apr 14 17:24:45 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:24:45 user nova-compute[71689]:     </video>
Apr 14 17:24:45 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:24:45 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:24:45 user nova-compute[71689]:     </rng>
Apr 14 17:24:45 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:24:45 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:24:45 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:24:45 user nova-compute[71689]:     </memballoon>
Apr 14 17:24:45 user nova-compute[71689]:   </devices>
Apr 14 17:24:45 user nova-compute[71689]: </domain>
Apr 14 17:24:45 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1884229091',display_name='tempest-ServerActionsTestJSON-server-1884229091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1884229091',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-hy00qi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=66599df0-d961-404f-9573-fe0289019752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG os_vif [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb85a290c-1e, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb85a290c-1e, col_values=(('external_ids', {'iface-id': 'b85a290c-1e7e-4f74-8590-be96f453decf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:4c:87', 'vm-uuid': '66599df0-d961-404f-9573-fe0289019752'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:45 user nova-compute[71689]: INFO os_vif [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e')
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:95:4c:87, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:24:45 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Took 0.57 seconds to deallocate network for instance.
Apr 14 17:24:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:24:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:46 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Deleted allocations for instance b9628e25-8292-4b41-87dd-e6149a31f768
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "b9628e25-8292-4b41-87dd-e6149a31f768" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.911s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Acquiring lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Lock "b9628e25-8292-4b41-87dd-e6149a31f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] No waiting events found dispatching network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:46 user nova-compute[71689]: WARNING nova.compute.manager [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received unexpected event network-vif-plugged-8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance with vm_state deleted and task_state None.
Apr 14 17:24:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Received event network-vif-deleted-8faddbf2-7a4e-4c78-856d-0d858d8b9cad {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:46 user nova-compute[71689]: WARNING nova.compute.manager [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state building and task_state spawning.
Apr 14 17:24:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493088.837123, 66599df0-d961-404f-9573-fe0289019752 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:24:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] VM Resumed (Lifecycle Event)
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:24:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance spawned successfully.
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:24:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493088.8409452, 66599df0-d961-404f-9573-fe0289019752 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:24:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] VM Started (Lifecycle Event)
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:24:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:24:48 user nova-compute[71689]: INFO nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Took 5.20 seconds to spawn the instance on the hypervisor.
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:48 user nova-compute[71689]: WARNING nova.compute.manager [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state building and task_state spawning.
Apr 14 17:24:49 user nova-compute[71689]: INFO nova.compute.manager [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Took 11.63 seconds to build instance.
Apr 14 17:24:49 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.742s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:24:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:24:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:54 user nova-compute[71689]: INFO nova.compute.manager [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Terminating instance
Apr 14 17:24:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Instance destroyed successfully.
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.objects.instance [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'resources' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-645603562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-645603562',id=31,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-jcsyelxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:23:08Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=99e98b6d-e5dd-49b7-b5ec-fba07fed70b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "address": "fa:16:3e:4e:b7:0b", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9262ab81-56", "ovs_interfaceid": "9262ab81-5611-4d5e-b32b-082b3c4981fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_vif [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9262ab81-56, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: INFO os_vif [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=9262ab81-5611-4d5e-b32b-082b3c4981fd,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9262ab81-56')
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyHsqmES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:24:55 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34edba-9fb4-4faf-8182-6481a4304bfc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:24:55 user nova-compute[71689]: No targets found.
Apr 14 17:24:55 user nova-compute[71689]: iSNS:
Apr 14 17:24:55 user nova-compute[71689]: No targets found.
Apr 14 17:24:55 user nova-compute[71689]: STATIC:
Apr 14 17:24:55 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:24:55 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:55 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:55 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:24:55 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:55 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:55 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:24:55 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:55 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:55 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28
Apr 14 17:24:55 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:24:55 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:24:55 user nova-compute[71689]: FIRMWARE:
Apr 14 17:24:55 user nova-compute[71689]: No targets found.
Apr 14 17:24:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:24:55 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:24:55 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6617070-93ce-48e6-bc6d-a6191b84923a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f496a588-01de-428c-a9bf-d1344e1cb1f3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:24:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b59475f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28'): ({'sde'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Removing single pathed devices sde {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f8ea57-e4fd-4dfe-bd52-722cca88ae2b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21d74a-08fc-4b46-915b-7a962bbbeb6a]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flushing IO for device /dev/sde {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4aae5-0923-44f6-9244-365e75a89c06]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f5dab9-6f5d-4c80-92de-8d2f9a674ffe]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] SCSI volumes sde have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23231366563306630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6ebd92bf', '/dev/disk/by-id/scsi-1SCST_BIO6ebd92bf-216ec0f0388fb5d1') {{(pid=81988) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[00469723-89df-435b-bd97-20f9a62614a1]: (4, None) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d666c-08bf-4260-b027-2390348c9dd9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd448d5b-1d38-4819-adad-621d78f7c2a0]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260]
Apr 14 17:24:55 user nova-compute[71689]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28, portal: 172.16.0.220,3260] successful.
Apr 14 17:24:55 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05bb9c07-31ea-4c72-9153-5df8be147d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4145215c-8ea6-43b7-a2e2-1fc48ec66f2b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== disconnect_volume: return (423ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:24:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Deleting instance files /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3_del
Apr 14 17:24:55 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Deletion of /opt/stack/data/nova/instances/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3_del complete
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:24:55 user nova-compute[71689]: INFO nova.compute.manager [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 14 17:24:55 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:24:55 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:24:56 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Took 0.97 seconds to deallocate network for instance.
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-deleted-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:56 user nova-compute[71689]: WARNING nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state deleting.
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:56 user nova-compute[71689]: WARNING nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state deleting.
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:56 user nova-compute[71689]: WARNING nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state deleting.
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-unplugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Acquiring lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] No waiting events found dispatching network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:24:56 user nova-compute[71689]: WARNING nova.compute.manager [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Received unexpected event network-vif-plugged-9262ab81-5611-4d5e-b32b-082b3c4981fd for instance with vm_state active and task_state deleting.
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:56 user nova-compute[71689]: INFO nova.compute.manager [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attaching volume 4f873d10-45a0-45c9-97f0-38db11ddc1a1 to /dev/vdb
Apr 14 17:24:56 user nova-compute[71689]: DEBUG os_brick.utils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a061ab-71f9-4823-af32-e1337846a668]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc26fc00-ece0-42f3-be70-6a9234e15571]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[020be5a7-978b-4182-bc37-3d5190f88e82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[424dd74b-0959-4bac-a194-b87ff0da9355]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:24:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:24:57 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:24:57 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a44e90-e6ac-4104-ba09-e5f19a36ac0e]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG os_brick.utils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating existing volume attachment record: 0d6e28d0-4f1c-4d7e-b4e2-40c805f391f4 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:24:57 user nova-compute[71689]: INFO nova.compute.manager [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 17:24:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:24:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:57 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Deleted allocations for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3
Apr 14 17:24:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.703s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:24:59 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493084.8558624, b9628e25-8292-4b41-87dd-e6149a31f768 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:24:59 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] VM Stopped (Lifecycle Event)
Apr 14 17:24:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9d9a2845-b920-4ead-8be6-cd0796d8d49e None None] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:25:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing instance network info cache due to event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:02 user nova-compute[71689]: INFO nova.compute.manager [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Detaching volume 5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:25:02 user nova-compute[71689]: INFO nova.virt.block_device [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Attempting to driver detach volume 5380e47e-86ce-482e-b6d7-b756348399d5 from mountpoint /dev/vdb
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Attempting to detach device vdb from instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:25:02 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:02 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:25:02 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:02 user nova-compute[71689]:   <serial>5380e47e-86ce-482e-b6d7-b756348399d5</serial>
Apr 14 17:25:02 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:25:02 user nova-compute[71689]: </disk>
Apr 14 17:25:02 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:25:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully detached device vdb from instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c from the persistent domain config.
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:25:02 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:02 user nova-compute[71689]:   <source dev="/dev/sdf"/>
Apr 14 17:25:02 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:02 user nova-compute[71689]:   <serial>5380e47e-86ce-482e-b6d7-b756348399d5</serial>
Apr 14 17:25:02 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:25:02 user nova-compute[71689]: </disk>
Apr 14 17:25:02 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updated VIF entry in instance network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:25:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493103.1097383, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:25:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully detached device vdb from instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c from the live domain config.
Apr 14 17:25:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUAfqYQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:25:03 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6180b93f-9ec9-40d5-9c50-39c63f07dae2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:25:03 user nova-compute[71689]: No targets found.
Apr 14 17:25:03 user nova-compute[71689]: iSNS:
Apr 14 17:25:03 user nova-compute[71689]: No targets found.
Apr 14 17:25:03 user nova-compute[71689]: STATIC:
Apr 14 17:25:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5
Apr 14 17:25:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:25:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:25:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:03 user nova-compute[71689]: FIRMWARE:
Apr 14 17:25:03 user nova-compute[71689]: No targets found.
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:25:03 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:25:03 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54b5ce-3da6-4d40-9df4-70031a0467fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ec6fe-3468-4cdd-916a-c1ae195a3fda]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c13d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5'): ({'sdf'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Removing single pathed devices sdf {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ba5c8-2062-4c55-88b5-56e45c810010]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d07c95-c8b5-4854-96e9-ac0ab32f71fd]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flushing IO for device /dev/sdf {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3c848-fc60-43a6-a77e-7f653aa76986]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa377dc-357a-4a0d-b797-fef75b55102f]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] SCSI volumes sdf have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec17f45-2bbe-4989-bd3d-dfb2f2b5f621]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db449491-6d2f-4724-8564-ec9a4d7658fa]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260]
Apr 14 17:25:03 user nova-compute[71689]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5, portal: 172.16.0.220,3260] successful.
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5380e47e-86ce-482e-b6d7-b756348399d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[390a020d-401b-48a5-8bbf-f3f059fedf19]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] <== disconnect_volume: return (319ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTlDOfdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:25:03 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:03 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:03 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9741416-a05d-468b-87e3-bfff4227040b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:25:03 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[518490a6-228b-4c2b-9972-7980d788f285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1] added
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b39aea2-ce6b-4557-a2b3-443700364551]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6973472e-04b9-41e5-b447-10c7face0464]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTlDOfdp {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTlDOfdp" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b51cf6c-edea-4792-bc33-d8376883258e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTlDOfdp'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b14a7c9-41be-4455-b690-fe86beb5102d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f657a-4bd0-49b5-9908-5a8e580f438d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade9eea9-b239-487d-a09c-9ed13ba0c5c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260]
Apr 14 17:25:03 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260] successful.
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b98a9b2-99ee-457d-a685-a53b908e3b14]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[258874d8-95fc-4d44-9f3a-cc60a12badc3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 (non-flash)
Apr 14 17:25:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbca8d9-2e8c-4824-8d44-093124998607]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:25:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTlDOfdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing instance network info cache due to event network-changed-0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Acquiring lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Acquired lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.network.neutron [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Refreshing network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.objects.instance [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.network.neutron [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updated VIF entry in instance network info cache for port 0880f945-0fa6-4f84-a9ea-71c15e634ac7. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.network.neutron [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [{"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Releasing lock "refresh_cache-0cf7a0ce-87a0-4a24-8410-26d056e8816c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23033663137333837', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033663137333837', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:25:04 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:04 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:25:04 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:04 user nova-compute[71689]:   <serial>4f873d10-45a0-45c9-97f0-38db11ddc1a1</serial>
Apr 14 17:25:04 user nova-compute[71689]: </disk>
Apr 14 17:25:04 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:25:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:25:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:25:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No VIF found with MAC fa:16:3e:d6:23:b6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:25:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.631s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:07 user nova-compute[71689]: INFO nova.compute.manager [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Detaching volume 4f873d10-45a0-45c9-97f0-38db11ddc1a1
Apr 14 17:25:07 user nova-compute[71689]: INFO nova.virt.block_device [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attempting to driver detach volume 4f873d10-45a0-45c9-97f0-38db11ddc1a1 from mountpoint /dev/vdb
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Attempting to detach device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:25:07 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:07 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:25:07 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:07 user nova-compute[71689]:   <serial>4f873d10-45a0-45c9-97f0-38db11ddc1a1</serial>
Apr 14 17:25:07 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:25:07 user nova-compute[71689]: </disk>
Apr 14 17:25:07 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:25:07 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config.
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:25:07 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:07 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:25:07 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:07 user nova-compute[71689]:   <serial>4f873d10-45a0-45c9-97f0-38db11ddc1a1</serial>
Apr 14 17:25:07 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:25:07 user nova-compute[71689]: </disk>
Apr 14 17:25:07 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493107.7483885, 15ce59e7-b263-4e0b-9f19-638db9606c7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:25:07 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config.
Apr 14 17:25:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTlDOfdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:25:07 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf2284-56fe-4b6d-95b3-e8f4b1a012de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:25:07 user nova-compute[71689]: No targets found.
Apr 14 17:25:07 user nova-compute[71689]: iSNS:
Apr 14 17:25:07 user nova-compute[71689]: No targets found.
Apr 14 17:25:07 user nova-compute[71689]: STATIC:
Apr 14 17:25:07 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:25:07 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:07 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:07 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:25:07 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:07 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:07 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1
Apr 14 17:25:07 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:07 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:07 user nova-compute[71689]: FIRMWARE:
Apr 14 17:25:07 user nova-compute[71689]: No targets found.
Apr 14 17:25:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:25:07 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:25:07 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76538cbb-077c-46d3-be65-54998ae9252e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[773b169f-6206-4a54-a2f3-e2964945788b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:07 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:07 user nova-compute[71689]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 (non-flash)
Apr 14 17:25:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:07 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:07 user nova-compute[71689]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 (non-flash)
Apr 14 17:25:07 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4e09ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9886bd81-1b08-4cca-b7a5-fb5c8d289ffa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1560a49a-88e7-4afa-b579-6ec7867f88ac]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbba527-93c9-43ef-910f-be42feed6d7e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[38776daf-54bc-4ab7-a577-8126e906144d]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b2955-5493-44c2-a847-208dc727e2a7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:07 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[70171432-62af-4a1a-923b-5275c8ba92a1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260]
Apr 14 17:25:08 user nova-compute[71689]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1, portal: 172.16.0.220,3260] successful.
Apr 14 17:25:08 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f873d10-45a0-45c9-97f0-38db11ddc1a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88114bc-568a-452a-8492-4699cb7be568]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== disconnect_volume: return (314ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG nova.objects.instance [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:09 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493094.9969668, 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:25:10 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] VM Stopped (Lifecycle Event)
Apr 14 17:25:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-74f7212c-6d2e-4031-af20-57a72f8c9db7 None None] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:25:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-changed-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Refreshing instance network info cache due to event network-changed-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Acquiring lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Acquired lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG nova.network.neutron [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Refreshing network info cache for port 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'flavor' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:15 user nova-compute[71689]: INFO nova.compute.manager [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Attaching volume abc6b635-bdf6-480f-a80a-de3af477bf40 to /dev/vdb
Apr 14 17:25:15 user nova-compute[71689]: DEBUG os_brick.utils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd0dca-8f5d-47df-8186-2f725d84b1fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1176fdc-3d86-475e-8c33-bb089ea19bd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8627819-908a-4d19-8e0a-3a1c23363a20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aabe42-baeb-4c5d-949a-f0bfc3849bd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:25:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:25:16 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:25:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e03d65-89a8-4ea9-8d09-4f861f30e2d5]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG os_brick.utils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updating existing volume attachment record: 594fbde1-0083-43f6-bd66-2fe58dc6262e {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updated VIF entry in instance network info cache for port 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG nova.network.neutron [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updating instance_info_cache with network_info: [{"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:25:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Releasing lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpgZJlvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:25:20 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:20 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:20 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b9b57-df5b-4198-9f78-88950bcbd02c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:25:20 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8e927-00d4-4561-8882-21c3b2f6395e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40] added
Apr 14 17:25:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59729daf-b534-41ad-8d22-50ceff5e054b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc9ec5c-27b0-4941-ad1f-a5a41ee515a7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpgZJlvT {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpgZJlvT" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e477e-db6b-46e4-b886-edd5798187fa]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpgZJlvT'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e19f300-eb4f-4f58-9f30-684ca838c2d4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28d5cc5-c742-4d55-9661-8c6659669db2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadf248e-a757-4ab0-9863-7095bbac9842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260]
Apr 14 17:25:20 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260] successful.
Apr 14 17:25:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab6e5d-bedd-460c-bde5-70987f8dd3a4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec74c6fd-a2dc-452a-800c-d97bd0ac5875]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 (non-flash)
Apr 14 17:25:20 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68ac82c-ede8-4a84-a167-30b6c065d096]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:20 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpgZJlvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23663393935633062', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663393935633062', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'flavor' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:25:21 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:21 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:25:21 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:21 user nova-compute[71689]:   <serial>abc6b635-bdf6-480f-a80a-de3af477bf40</serial>
Apr 14 17:25:21 user nova-compute[71689]: </disk>
Apr 14 17:25:21 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:25:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:25:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:25:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] No VIF found with MAC fa:16:3e:e7:22:7c, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:25:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.521s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:23 user nova-compute[71689]: INFO nova.compute.manager [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Detaching volume abc6b635-bdf6-480f-a80a-de3af477bf40
Apr 14 17:25:23 user nova-compute[71689]: INFO nova.virt.block_device [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Attempting to driver detach volume abc6b635-bdf6-480f-a80a-de3af477bf40 from mountpoint /dev/vdb
Apr 14 17:25:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Attempting to detach device vdb from instance f1607fec-229c-4bce-b9d4-b8b01a650859 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:25:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:25:23 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:23 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:25:23 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:23 user nova-compute[71689]:   <serial>abc6b635-bdf6-480f-a80a-de3af477bf40</serial>
Apr 14 17:25:23 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:25:23 user nova-compute[71689]: </disk>
Apr 14 17:25:23 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:25:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully detached device vdb from instance f1607fec-229c-4bce-b9d4-b8b01a650859 from the persistent domain config.
Apr 14 17:25:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1607fec-229c-4bce-b9d4-b8b01a650859 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:25:24 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:25:24 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:25:24 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:25:24 user nova-compute[71689]:   <serial>abc6b635-bdf6-480f-a80a-de3af477bf40</serial>
Apr 14 17:25:24 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:25:24 user nova-compute[71689]: </disk>
Apr 14 17:25:24 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493124.4289763, f1607fec-229c-4bce-b9d4-b8b01a650859 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:25:24 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully detached device vdb from instance f1607fec-229c-4bce-b9d4-b8b01a650859 from the live domain config.
Apr 14 17:25:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpgZJlvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:25:24 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc96272-15dd-4237-8dff-845a95963ff9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:25:24 user nova-compute[71689]: No targets found.
Apr 14 17:25:24 user nova-compute[71689]: iSNS:
Apr 14 17:25:24 user nova-compute[71689]: No targets found.
Apr 14 17:25:24 user nova-compute[71689]: STATIC:
Apr 14 17:25:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40
Apr 14 17:25:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:25:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:24 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:25:24 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:25:24 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:25:24 user nova-compute[71689]: FIRMWARE:
Apr 14 17:25:24 user nova-compute[71689]: No targets found.
Apr 14 17:25:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:25:24 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:25:24 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3015b1fc-6fe3-46cf-84f1-5878f7319cb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3e53e3-6501-41c7-a600-90ee3bb4897c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:24 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:24 user nova-compute[71689]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 (non-flash)
Apr 14 17:25:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:25:24 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:25:24 user nova-compute[71689]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 (non-flash)
Apr 14 17:25:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c13e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[827d68d8-47b8-4808-90b0-46a9949f52e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cffb212-ff18-4ae8-b3d2-02423c667073]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4154c22-dbdc-4d16-a6b0-ccaf307663d1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af15e8-58c3-42da-8ec4-d1996613bd99]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c34cea-9232-449f-99d7-74e6aa7b591a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9fa469-fe77-41c0-abe6-38a613296927]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260]
Apr 14 17:25:24 user nova-compute[71689]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40, portal: 172.16.0.220,3260] successful.
Apr 14 17:25:24 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc6b635-bdf6-480f-a80a-de3af477bf40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f4876-ced6-4436-a6dd-f5fda3d9c919]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] <== disconnect_volume: return (331ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:25:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:25:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:25 user nova-compute[71689]: DEBUG nova.objects.instance [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'flavor' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.776s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [{"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-1d1a580c-99da-46df-b02d-e2462d8ef26b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:25:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:25:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:25:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:25:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:25:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:25:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=7793MB free_disk=25.901290893554688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance f1607fec-229c-4bce-b9d4-b8b01a650859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:25:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:44 user nova-compute[71689]: INFO nova.compute.manager [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Terminating instance
Apr 14 17:25:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-vif-unplugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] No waiting events found dispatching network-vif-unplugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-vif-unplugged-26192624-8026-443e-8abd-c2890d04fd77 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Instance destroyed successfully.
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.objects.instance [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'resources' on Instance uuid a3e1f09c-567e-41d1-9c35-58b8371a1d1c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-119717964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-119717964',id=27,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:16:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-beyddcwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:18:19Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=a3e1f09c-567e-41d1-9c35-58b8371a1d1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "26192624-8026-443e-8abd-c2890d04fd77", "address": "fa:16:3e:ba:6b:ed", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26192624-80", "ovs_interfaceid": "26192624-8026-443e-8abd-c2890d04fd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG os_vif [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26192624-80, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:25:45 user nova-compute[71689]: INFO os_vif [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=26192624-8026-443e-8abd-c2890d04fd77,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26192624-80')
Apr 14 17:25:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Deleting instance files /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c_del
Apr 14 17:25:45 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Deletion of /opt/stack/data/nova/instances/a3e1f09c-567e-41d1-9c35-58b8371a1d1c_del complete
Apr 14 17:25:45 user nova-compute[71689]: INFO nova.compute.manager [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 17:25:45 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:25:45 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:25:46 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Took 0.66 seconds to deallocate network for instance.
Apr 14 17:25:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-vif-deleted-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:25:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:46 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Deleted allocations for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c
Apr 14 17:25:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received event network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Acquiring lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Lock "a3e1f09c-567e-41d1-9c35-58b8371a1d1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] No waiting events found dispatching network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:47 user nova-compute[71689]: WARNING nova.compute.manager [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Received unexpected event network-vif-plugged-26192624-8026-443e-8abd-c2890d04fd77 for instance with vm_state deleted and task_state None.
Apr 14 17:25:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:52 user nova-compute[71689]: INFO nova.compute.manager [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Terminating instance
Apr 14 17:25:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Instance destroyed successfully.
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'resources' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1625534792',display_name='tempest-ServerRescueNegativeTestJSON-server-1625534792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1625534792',id=30,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkhzx0v+7HCaZJW3pk9TowcDAVJ9KFpdiCNY5OOsCtGsGIFyP4OqSdppPhYkTIq5yQOHS6w//2BPtL2ClUJ4uuMEC/DjDyTWFx1NhxIBjDDsrLaSzKGJ838USTQRm0i2Q==',key_name='tempest-keypair-167549610',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-9d98m502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2434278fe61447fab1f5a930aa16a1de',uuid=0cf7a0ce-87a0-4a24-8410-26d056e8816c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "address": "fa:16:3e:ff:b9:cd", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0880f945-0f", "ovs_interfaceid": "0880f945-0fa6-4f84-a9ea-71c15e634ac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG os_vif [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0880f945-0f, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: INFO os_vif [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:b9:cd,bridge_name='br-int',has_traffic_filtering=True,id=0880f945-0fa6-4f84-a9ea-71c15e634ac7,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0880f945-0f')
Apr 14 17:25:53 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Deleting instance files /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c_del
Apr 14 17:25:53 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Deletion of /opt/stack/data/nova/instances/0cf7a0ce-87a0-4a24-8410-26d056e8816c_del complete
Apr 14 17:25:53 user nova-compute[71689]: INFO nova.compute.manager [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 17:25:53 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:25:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:25:55 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Took 1.39 seconds to deallocate network for instance.
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:55 user nova-compute[71689]: WARNING nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state deleted and task_state None.
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:55 user nova-compute[71689]: WARNING nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state deleted and task_state None.
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:55 user nova-compute[71689]: WARNING nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state deleted and task_state None.
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:55 user nova-compute[71689]: WARNING nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-unplugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state deleted and task_state None.
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Acquiring lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] No waiting events found dispatching network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:25:55 user nova-compute[71689]: WARNING nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received unexpected event network-vif-plugged-0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance with vm_state deleted and task_state None.
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Received event network-vif-deleted-0880f945-0fa6-4f84-a9ea-71c15e634ac7 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:55 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Deleted allocations for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c
Apr 14 17:25:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "0cf7a0ce-87a0-4a24-8410-26d056e8816c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:25:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:00 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493145.4904807, a3e1f09c-567e-41d1-9c35-58b8371a1d1c => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:26:00 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] VM Stopped (Lifecycle Event)
Apr 14 17:26:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ec54e09c-d63c-4df9-8cc7-49343461e347 None None] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:02 user nova-compute[71689]: INFO nova.compute.manager [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attaching volume c977ae16-fe3f-484c-a096-cf1a26e924bf to /dev/vdb
Apr 14 17:26:02 user nova-compute[71689]: DEBUG os_brick.utils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea02d8-8672-4287-9904-6eb9d76a1a2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7db670-6bd3-49a6-92c7-eb3fc2318aa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd26d59-7b75-4b6b-8c4d-17add7190af9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c64e9-72c4-41aa-a5eb-c3f806fb8351]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:26:02 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:26:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba9fbb-afe5-4194-ab8a-f0c877dc524f]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG os_brick.utils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:02 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating existing volume attachment record: a37d998c-f960-481c-a743-cd1d110e6310 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:26:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:08 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493153.744927, 0cf7a0ce-87a0-4a24-8410-26d056e8816c => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:26:08 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] VM Stopped (Lifecycle Event)
Apr 14 17:26:08 user nova-compute[71689]: DEBUG nova.compute.manager [None req-1467c59f-68c7-4e71-a853-06043536a770 None None] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:26:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsSQzKru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:09 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:09 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:09 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177591b-935f-485a-8fd3-e4b16a478fbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:26:09 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[332e389d-0c77-4173-a53e-a5c43ebbe9c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf] added
Apr 14 17:26:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb51dd6-2169-4963-889f-fa6f9572e81f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfb2c8-e7c6-4607-bf56-842ff55d2edb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NsSQzKru {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NsSQzKru" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b878cea-3c6d-49db-81ef-a873cf46b56a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NsSQzKru'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef87bf1d-211a-4aa1-ab87-d5031ff9bf31]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b675485d-f5e4-4543-940c-674660d748eb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a6317-4346-4824-a102-8c4b6be6d20e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260]
Apr 14 17:26:09 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260] successful.
Apr 14 17:26:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f64b91-b781-4679-b35b-e142b9d4cfee]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[83266509-d16e-48c4-a0f6-ef39ed1ed933]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf (non-flash)
Apr 14 17:26:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:09 user nova-compute[71689]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf (non-flash)
Apr 14 17:26:09 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4e627e-d9e8-464b-b5fd-7f23c086c8b2]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:26:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsSQzKru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:26:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:10 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23364386237313763', 'path': '/dev/sdd'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364386237313763', 'path': '/dev/sdd'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:26:10 user nova-compute[71689]: DEBUG nova.objects.instance [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:10 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:26:10 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:26:10 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:26:10 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:26:10 user nova-compute[71689]:   <serial>c977ae16-fe3f-484c-a096-cf1a26e924bf</serial>
Apr 14 17:26:10 user nova-compute[71689]: </disk>
Apr 14 17:26:10 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:26:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:26:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:26:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] No VIF found with MAC fa:16:3e:d6:23:b6, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:26:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.595s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:12 user nova-compute[71689]: INFO nova.compute.manager [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Detaching volume c977ae16-fe3f-484c-a096-cf1a26e924bf
Apr 14 17:26:12 user nova-compute[71689]: INFO nova.virt.block_device [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Attempting to driver detach volume c977ae16-fe3f-484c-a096-cf1a26e924bf from mountpoint /dev/vdb
Apr 14 17:26:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Attempting to detach device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:26:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:26:12 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:26:12 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:26:12 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:26:12 user nova-compute[71689]:   <serial>c977ae16-fe3f-484c-a096-cf1a26e924bf</serial>
Apr 14 17:26:12 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:26:12 user nova-compute[71689]: </disk>
Apr 14 17:26:12 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:26:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the persistent domain config.
Apr 14 17:26:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:26:13 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:26:13 user nova-compute[71689]:   <source dev="/dev/sdd"/>
Apr 14 17:26:13 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:26:13 user nova-compute[71689]:   <serial>c977ae16-fe3f-484c-a096-cf1a26e924bf</serial>
Apr 14 17:26:13 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:26:13 user nova-compute[71689]: </disk>
Apr 14 17:26:13 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493173.4550297, 15ce59e7-b263-4e0b-9f19-638db9606c7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:26:13 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully detached device vdb from instance 15ce59e7-b263-4e0b-9f19-638db9606c7b from the live domain config.
Apr 14 17:26:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsSQzKru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:13 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce02c53-aa0c-4590-8bff-3bd2eef90b5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:26:13 user nova-compute[71689]: No targets found.
Apr 14 17:26:13 user nova-compute[71689]: iSNS:
Apr 14 17:26:13 user nova-compute[71689]: No targets found.
Apr 14 17:26:13 user nova-compute[71689]: STATIC:
Apr 14 17:26:13 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf
Apr 14 17:26:13 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:26:13 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:26:13 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:26:13 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:26:13 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:26:13 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:26:13 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:26:13 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:26:13 user nova-compute[71689]: FIRMWARE:
Apr 14 17:26:13 user nova-compute[71689]: No targets found.
Apr 14 17:26:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:26:13 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:26:13 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98e0a3a-2c63-4297-9c77-1fac8d506a55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4341275e-0f0f-4bbe-9612-f512c0e047ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:13 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:13 user nova-compute[71689]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf (non-flash)
Apr 14 17:26:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:13 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:13 user nova-compute[71689]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf (non-flash)
Apr 14 17:26:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c75bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf'): ({'sdd'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Removing single pathed devices sdd {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fbd927-38e3-4f7b-9431-09e56d7888a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cf7d25-7cf1-47c6-90ef-9c6d9d4437f9]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flushing IO for device /dev/sdd {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa676037-ba95-4b7c-a752-0e698186fa66]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b685075f-b14c-4217-a7b0-961619f44d99]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] SCSI volumes sdd have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9eb3eb-62b6-423f-9d4a-0f8595a23ade]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c301a-d0dd-4cc4-9911-6e89611905e2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260]
Apr 14 17:26:13 user nova-compute[71689]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf, portal: 172.16.0.220,3260] successful.
Apr 14 17:26:13 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c977ae16-fe3f-484c-a096-cf1a26e924bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[648c8486-0bf7-45a9-91aa-9ab86aad8296]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] <== disconnect_volume: return (303ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:26:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG nova.objects.instance [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'flavor' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-changed-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Refreshing instance network info cache due to event network-changed-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Acquiring lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Acquired lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:26:14 user nova-compute[71689]: DEBUG nova.network.neutron [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Refreshing network info cache for port 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:15 user nova-compute[71689]: INFO nova.compute.manager [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Terminating instance
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-vif-unplugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] No waiting events found dispatching network-vif-unplugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-vif-unplugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.network.neutron [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updated VIF entry in instance network info cache for port 5d23bb5b-a645-4a30-9fcf-177b0bfd64f5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.network.neutron [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updating instance_info_cache with network_info: [{"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Releasing lock "refresh_cache-f1607fec-229c-4bce-b9d4-b8b01a650859" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:26:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Instance destroyed successfully.
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'resources' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1710972168',display_name='tempest-TestStampPattern-server-1710972168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1710972168',id=36,image_ref='b82a7509-0a29-4cd7-84f4-661d4214f0b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA==',key_name='tempest-TestStampPattern-1893968129',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ab08f97dd54832a7cc975934b1b69f',ramdisk_id='',reservation_id='r-aco4xyaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='15a48598-5e5d-450b-a6c5-d7637a6d8682',image_min_disk='1',image_min_ram='0',image_owner_id='f7ab08f97dd54832a7cc975934b1b69f',image_owner_project_name='tempest-TestStampPattern-872060463',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-872060463-project-member',image_user_id='b8ea39d187c842788168909de203455e',owner_project_name='tempest-TestStampPattern-872060463',owner_user_name='tempest-TestStampPattern-872060463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:23:30Z,user_data=None,user_id='b8ea39d187c842788168909de203455e',uuid=f1607fec-229c-4bce-b9d4-b8b01a650859,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converting VIF {"id": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "address": "fa:16:3e:e7:22:7c", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23bb5b-a6", "ovs_interfaceid": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG os_vif [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d23bb5b-a6, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:15 user nova-compute[71689]: INFO os_vif [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d23bb5b-a645-4a30-9fcf-177b0bfd64f5,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23bb5b-a6')
Apr 14 17:26:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Deleting instance files /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859_del
Apr 14 17:26:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Deletion of /opt/stack/data/nova/instances/f1607fec-229c-4bce-b9d4-b8b01a650859_del complete
Apr 14 17:26:15 user nova-compute[71689]: INFO nova.compute.manager [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 17:26:15 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:26:15 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:26:16 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:16 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Took 0.57 seconds to deallocate network for instance.
Apr 14 17:26:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:26:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:26:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:16 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Deleted allocations for instance f1607fec-229c-4bce-b9d4-b8b01a650859
Apr 14 17:26:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-vif-deleted-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.006s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received event network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Acquiring lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Lock "f1607fec-229c-4bce-b9d4-b8b01a650859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] No waiting events found dispatching network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:17 user nova-compute[71689]: WARNING nova.compute.manager [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Received unexpected event network-vif-plugged-5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance with vm_state deleted and task_state None.
Apr 14 17:26:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-changed-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Refreshing instance network info cache due to event network-changed-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Acquiring lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Acquired lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG nova.network.neutron [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Refreshing network info cache for port ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG nova.network.neutron [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updated VIF entry in instance network info cache for port ff6f2e44-8051-46b5-9b63-46b5fcc6db6a. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG nova.network.neutron [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Releasing lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:26:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Stashing vm_state: active {{(pid=71689) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 17:26:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_requests' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:26:29 user nova-compute[71689]: INFO nova.compute.claims [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Claim successful on node user
Apr 14 17:26:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'pci_devices' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:29 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating resource usage from migration 0ef22b9f-1a39-4541-b224-166407fbfae4
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-changed-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Refreshing instance network info cache due to event network-changed-b85a290c-1e7e-4f74-8590-be96f453decf. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Refreshing network info cache for port b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.395s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:30 user nova-compute[71689]: INFO nova.compute.manager [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Migrating
Apr 14 17:26:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Updated VIF entry in instance network info cache for port b85a290c-1e7e-4f74-8590-be96f453decf. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493175.8428671, f1607fec-229c-4bce-b9d4-b8b01a650859 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:26:30 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] VM Stopped (Lifecycle Event)
Apr 14 17:26:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e8452fe5-75bc-4529-a592-fca4aee83e91 None None] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:26:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Starting migrate_disk_and_power_off {{(pid=71689) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance destroyed successfully.
Apr 14 17:26:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1884229091',display_name='tempest-ServerActionsTestJSON-server-1884229091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1884229091',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:24:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-hy00qi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=66599df0-d961-404f-9573-fe0289019752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb85a290c-1e, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:31 user nova-compute[71689]: INFO os_vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e')
Apr 14 17:26:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:31 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77478531-8d3a-47d5-bb19-41e23ee46c45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:26:31 user nova-compute[71689]: No targets found.
Apr 14 17:26:31 user nova-compute[71689]: iSNS:
Apr 14 17:26:31 user nova-compute[71689]: No targets found.
Apr 14 17:26:31 user nova-compute[71689]: STATIC:
Apr 14 17:26:31 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:26:31 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:26:31 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:26:31 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:26:31 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:26:31 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:26:31 user nova-compute[71689]: FIRMWARE:
Apr 14 17:26:31 user nova-compute[71689]: No targets found.
Apr 14 17:26:31 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:26:31 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:26:31 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac50934f-8fca-480a-b0a4-aeb24e2ad9ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:31 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad5f6d3-7834-4d69-ace2-8c5593f7b16b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:32 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:32 user nova-compute[71689]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c32b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153dd76-f628-4a25-bd95-3219adfd781f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0efbde-ab40-468d-910e-3fa25b7d32a0]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[130e6f65-f317-482e-a62d-231036c15072]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-unplugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-unplugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:32 user nova-compute[71689]: WARNING nova.compute.manager [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-unplugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state active and task_state resize_migrating.
Apr 14 17:26:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:32 user nova-compute[71689]: WARNING nova.compute.manager [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state active and task_state resize_migrating.
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37b46c3-7688-400a-82db-8e6549999041]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe3f9c64-11839917c92a5e70', '/dev/disk/by-id/scsi-23131383339393137', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e3f9c64') {{(pid=81988) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5708b486-e59e-42fb-92c9-9084a6d2cfe7]: (4, None) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc1712e-9d99-4e69-9d71-afbdde123b58]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e3f22-921a-4428-a99e-0e8280cec87b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]
Apr 14 17:26:32 user nova-compute[71689]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.
Apr 14 17:26:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e05c18-1aaf-4f98-8266-9637a7595186]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (338ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:26:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Port b85a290c-1e7e-4f74-8590-be96f453decf binding to destination host user is already ACTIVE {{(pid=71689) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG os_brick.utils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b56328a-3cd7-4c16-84b4-9564b748d109]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[83961568-273c-47a9-89bd-fd597de71e7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8e793-63da-4d94-8772-102296170825]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[04992871-a828-42b7-a5c5-84773f3aa6d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:26:34 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54546a4-8c20-40b2-bca1-ca9e51d75698]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG os_brick.utils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating instance_info_cache with network_info: [{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:26:34 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:35 user nova-compute[71689]: INFO nova.compute.manager [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Terminating instance
Apr 14 17:26:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-unplugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:26:36 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Instance destroyed successfully.
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.objects.instance [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'resources' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1024645093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1024645093',id=21,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-dodatc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:14:36Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=1d1a580c-99da-46df-b02d-e2462d8ef26b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "address": "fa:16:3e:7d:6e:78", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3e7d0d-e1", "ovs_interfaceid": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_vif [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc3e7d0d-e1, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:36 user nova-compute[71689]: INFO os_vif [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:6e:78,bridge_name='br-int',has_traffic_filtering=True,id=cc3e7d0d-e167-4a0d-b795-babe496d6f8d,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3e7d0d-e1')
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZiSeGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:36 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f98ee-6f89-4ef4-beca-64e68f59c99d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:26:36 user nova-compute[71689]: No targets found.
Apr 14 17:26:36 user nova-compute[71689]: iSNS:
Apr 14 17:26:36 user nova-compute[71689]: No targets found.
Apr 14 17:26:36 user nova-compute[71689]: STATIC:
Apr 14 17:26:36 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510
Apr 14 17:26:36 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:26:36 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:26:36 user nova-compute[71689]: FIRMWARE:
Apr 14 17:26:36 user nova-compute[71689]: No targets found.
Apr 14 17:26:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:26:36 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:26:36 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00cfb0-6b2c-458e-932d-5a3fc3a14223]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b032c-0727-43aa-8871-30f7bccab294]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 (non-flash)
Apr 14 17:26:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c0aa4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4476a4-d241-40b4-89d5-559e2dddc49b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4518401a-1c2d-410c-a08a-d4666648e02a]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2bdb4b-2e22-4ad2-ac08-75252af90a67]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb8082-0c61-45a3-a920-edab7b806f77]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb804d79-1f52-4cf0-81c1-59464e76800f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd04ccc-63f2-4d75-ad63-dd4ab591cfaa]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260]
Apr 14 17:26:36 user nova-compute[71689]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510, portal: 172.16.0.220,3260] successful.
Apr 14 17:26:36 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d88a38-1e4b-4cfe-9e40-632022a9f510 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff669771-c571-4543-bf4c-d1b5f49fd387]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] <== disconnect_volume: return (334ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:26:36 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Deleting instance files /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b_del
Apr 14 17:26:36 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Deletion of /opt/stack/data/nova/instances/1d1a580c-99da-46df-b02d-e2462d8ef26b_del complete
Apr 14 17:26:36 user nova-compute[71689]: INFO nova.compute.manager [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 14 17:26:36 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:26:36 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:37 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Took 1.01 seconds to deallocate network for instance.
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-deleted-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:37 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Acquiring lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] No waiting events found dispatching network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:38 user nova-compute[71689]: WARNING nova.compute.manager [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Received unexpected event network-vif-plugged-cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance with vm_state active and task_state deleting.
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: INFO nova.compute.manager [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Took 0.84 seconds to detach 1 volumes for instance.
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:39 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Deleted allocations for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Starting finish_migration {{(pid=71689) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance directory exists: not creating {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 17:26:39 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Creating image(s)
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Ensure instance console log exists: /opt/stack/data/nova/instances/66599df0-d961-404f-9573-fe0289019752/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Start _get_guest_xml network_info=[{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '66599df0-d961-404f-9573-fe0289019752', 'attached_at': '2023-04-14T17:26:39.000000', 'detached_at': '', 'volume_id': '6f629cce-a595-45d8-9afe-0f617ea75a87', 'serial': '6f629cce-a595-45d8-9afe-0f617ea75a87'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '723a2197-eb0f-49fb-ad7d-b8f00797b6da', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:26:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:26:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:26:39 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:39 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:26:39 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "1d1a580c-99da-46df-b02d-e2462d8ef26b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.791s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeee429-2623-46b8-acd0-a2f7d255c357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:26:39 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6500131-d5db-4b23-bb36-2c0add96afe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87] added
Apr 14 17:26:39 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ce1f5-b14c-4c2c-a3dc-f22cc77fca6b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77577eb7-c09e-4bfc-9b1d-cf84135e682a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxqGBiVm {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxqGBiVm" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c675bf-ae91-42c7-9aa6-495741ec9c84]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WxqGBiVm'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:26:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8137MB free_disk=26.001876831054688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c5771-022c-437e-afe0-e45896c07cba]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c780e-4d2b-4050-add8-6ab3b602a61d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:26:39 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:26:39 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:39 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:26:39 user nova-compute[71689]: 
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Applying migration context for instance 66599df0-d961-404f-9573-fe0289019752 as it has an incoming, in-progress migration 0ef22b9f-1a39-4541-b224-166407fbfae4. Migration status is post-migrating {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 17:26:39 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating resource usage from migration 0ef22b9f-1a39-4541-b224-166407fbfae4
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f193852-443c-4154-bd72-b08a38f14f8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]
Apr 14 17:26:39 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.
Apr 14 17:26:39 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Migration 0ef22b9f-1a39-4541-b224-166407fbfae4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda4471-a515-4b4f-a553-730a889f94f7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[698832de-c3c4-45ce-8384-6db1d4875f0b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:39 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:26:39 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.626s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa90353b-bc78-4083-b5a9-220caa07153a]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:26:39 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.667s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== connect_volume: return (1670ms) {'type': 'block', 'scsi_wwn': '23131383339393137', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:26:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131383339393137', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1884229091',display_name='tempest-ServerActionsTestJSON-server-1884229091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1884229091',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:24:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-hy00qi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=66599df0-d961-404f-9573-fe0289019752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:26:41 user nova-compute[71689]:   <uuid>66599df0-d961-404f-9573-fe0289019752</uuid>
Apr 14 17:26:41 user nova-compute[71689]:   <name>instance-00000025</name>
Apr 14 17:26:41 user nova-compute[71689]:   <memory>196608</memory>
Apr 14 17:26:41 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:26:41 user nova-compute[71689]:   <metadata>
Apr 14 17:26:41 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:26:41 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:26:41 user nova-compute[71689]:       <nova:name>tempest-ServerActionsTestJSON-server-1884229091</nova:name>
Apr 14 17:26:41 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:26:39</nova:creationTime>
Apr 14 17:26:41 user nova-compute[71689]:       <nova:flavor name="m1.micro">
Apr 14 17:26:41 user nova-compute[71689]:         <nova:memory>192</nova:memory>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:26:41 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:26:41 user nova-compute[71689]:       <nova:owner>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:user uuid="a22398c18fcc48aca2f0f9691f1c1143">tempest-ServerActionsTestJSON-2079488933-project-member</nova:user>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:project uuid="978cd1b4b6434b298731b01dac02591c">tempest-ServerActionsTestJSON-2079488933</nova:project>
Apr 14 17:26:41 user nova-compute[71689]:       </nova:owner>
Apr 14 17:26:41 user nova-compute[71689]:       <nova:ports>
Apr 14 17:26:41 user nova-compute[71689]:         <nova:port uuid="b85a290c-1e7e-4f74-8590-be96f453decf">
Apr 14 17:26:41 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:26:41 user nova-compute[71689]:         </nova:port>
Apr 14 17:26:41 user nova-compute[71689]:       </nova:ports>
Apr 14 17:26:41 user nova-compute[71689]:     </nova:instance>
Apr 14 17:26:41 user nova-compute[71689]:   </metadata>
Apr 14 17:26:41 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:26:41 user nova-compute[71689]:     <system>
Apr 14 17:26:41 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:26:41 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:26:41 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:26:41 user nova-compute[71689]:       <entry name="serial">66599df0-d961-404f-9573-fe0289019752</entry>
Apr 14 17:26:41 user nova-compute[71689]:       <entry name="uuid">66599df0-d961-404f-9573-fe0289019752</entry>
Apr 14 17:26:41 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:26:41 user nova-compute[71689]:     </system>
Apr 14 17:26:41 user nova-compute[71689]:   </sysinfo>
Apr 14 17:26:41 user nova-compute[71689]:   <os>
Apr 14 17:26:41 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:26:41 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:26:41 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:26:41 user nova-compute[71689]:   </os>
Apr 14 17:26:41 user nova-compute[71689]:   <features>
Apr 14 17:26:41 user nova-compute[71689]:     <acpi/>
Apr 14 17:26:41 user nova-compute[71689]:     <apic/>
Apr 14 17:26:41 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:26:41 user nova-compute[71689]:   </features>
Apr 14 17:26:41 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:26:41 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:26:41 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:26:41 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:26:41 user nova-compute[71689]:   </clock>
Apr 14 17:26:41 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:26:41 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:26:41 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:26:41 user nova-compute[71689]:   </cpu>
Apr 14 17:26:41 user nova-compute[71689]:   <devices>
Apr 14 17:26:41 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:26:41 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:26:41 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:26:41 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:26:41 user nova-compute[71689]:       <serial>6f629cce-a595-45d8-9afe-0f617ea75a87</serial>
Apr 14 17:26:41 user nova-compute[71689]:     </disk>
Apr 14 17:26:41 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:26:41 user nova-compute[71689]:       <mac address="fa:16:3e:95:4c:87"/>
Apr 14 17:26:41 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:26:41 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:26:41 user nova-compute[71689]:       <target dev="tapb85a290c-1e"/>
Apr 14 17:26:41 user nova-compute[71689]:     </interface>
Apr 14 17:26:41 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:26:41 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/66599df0-d961-404f-9573-fe0289019752/console.log" append="off"/>
Apr 14 17:26:41 user nova-compute[71689]:     </serial>
Apr 14 17:26:41 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:26:41 user nova-compute[71689]:     <video>
Apr 14 17:26:41 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:26:41 user nova-compute[71689]:     </video>
Apr 14 17:26:41 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:26:41 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:26:41 user nova-compute[71689]:     </rng>
Apr 14 17:26:41 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:26:41 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:26:41 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:26:41 user nova-compute[71689]:     </memballoon>
Apr 14 17:26:41 user nova-compute[71689]:   </devices>
Apr 14 17:26:41 user nova-compute[71689]: </domain>
Apr 14 17:26:41 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1884229091',display_name='tempest-ServerActionsTestJSON-server-1884229091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1884229091',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:24:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-hy00qi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=66599df0-d961-404f-9573-fe0289019752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-107397503-network", "vif_mac": "fa:16:3e:95:4c:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG os_vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb85a290c-1e, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb85a290c-1e, col_values=(('external_ids', {'iface-id': 'b85a290c-1e7e-4f74-8590-be96f453decf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:4c:87', 'vm-uuid': '66599df0-d961-404f-9573-fe0289019752'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:41 user nova-compute[71689]: INFO os_vif [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e')
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:26:41 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] No VIF found with MAC fa:16:3e:95:4c:87, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:42 user nova-compute[71689]: DEBUG nova.compute.manager [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:42 user nova-compute[71689]: WARNING nova.compute.manager [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state active and task_state resize_finish.
Apr 14 17:26:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.host [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Removed pending event for 66599df0-d961-404f-9573-fe0289019752 due to event {{(pid=71689) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493204.6125653, 66599df0-d961-404f-9573-fe0289019752 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:26:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] VM Resumed (Lifecycle Event)
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:26:44 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance running successfully.
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Failed to set time: agent not configured {{(pid=71689) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] finish_migration finished successfully. {{(pid=71689) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:44 user nova-compute[71689]: WARNING nova.compute.manager [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state active and task_state resize_finish.
Apr 14 17:26:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493204.614655, 66599df0-d961-404f-9573-fe0289019752 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:26:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] VM Started (Lifecycle Event)
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:26:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:26:44 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 17:26:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493196.3530204, 1d1a580c-99da-46df-b02d-e2462d8ef26b => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:26:51 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] VM Stopped (Lifecycle Event)
Apr 14 17:26:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3964e5e6-1ca6-44ce-a8f4-44205f2a9208 None None] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:51 user nova-compute[71689]: INFO nova.compute.manager [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Terminating instance
Apr 14 17:26:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-unplugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-unplugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.compute.manager [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-unplugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:26:52 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Instance destroyed successfully.
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'resources' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1925938594',display_name='tempest-ServerRescueNegativeTestJSON-server-1925938594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1925938594',id=20,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-r06rc0hs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:12:44Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=5c01d750-5923-4b61-9f3a-17cf1142f0a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "address": "fa:16:3e:bf:ad:b2", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d44e719-ff", "ovs_interfaceid": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG os_vif [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d44e719-ff, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:26:52 user nova-compute[71689]: INFO os_vif [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:ad:b2,bridge_name='br-int',has_traffic_filtering=True,id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d44e719-ff')
Apr 14 17:26:52 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Deleting instance files /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5_del
Apr 14 17:26:52 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Deletion of /opt/stack/data/nova/instances/5c01d750-5923-4b61-9f3a-17cf1142f0a5_del complete
Apr 14 17:26:52 user nova-compute[71689]: INFO nova.compute.manager [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 17:26:52 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:26:52 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:53 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Took 0.65 seconds to deallocate network for instance.
Apr 14 17:26:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-deleted-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:53 user nova-compute[71689]: INFO nova.compute.manager [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Neutron deleted interface 1d44e719-ffdb-40ff-8b17-bf5d79e1df7e; detaching it from the instance and deleting it from the info cache
Apr 14 17:26:53 user nova-compute[71689]: DEBUG nova.network.neutron [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG nova.compute.manager [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Detach interface failed, port_id=1d44e719-ffdb-40ff-8b17-bf5d79e1df7e, reason: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:26:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:53 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Deleted allocations for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5
Apr 14 17:26:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:26:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Acquiring lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:26:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:26:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Lock "5c01d750-5923-4b61-9f3a-17cf1142f0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:26:54 user nova-compute[71689]: DEBUG nova.compute.manager [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] No waiting events found dispatching network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:26:54 user nova-compute[71689]: WARNING nova.compute.manager [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Received unexpected event network-vif-plugged-1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance with vm_state deleted and task_state None.
Apr 14 17:26:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:07 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493212.5859551, 5c01d750-5923-4b61-9f3a-17cf1142f0a5 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:07 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] VM Stopped (Lifecycle Event)
Apr 14 17:27:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-b7924b03-bc67-465d-8eb3-37def0e3471e None None] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-changed-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Refreshing instance network info cache due to event network-changed-4e3c902c-c5f1-4842-8338-fc701ab2e11a. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Acquiring lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Acquired lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Refreshing network info cache for port 4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:13 user nova-compute[71689]: INFO nova.compute.manager [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Terminating instance
Apr 14 17:27:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updated VIF entry in instance network info cache for port 4e3c902c-c5f1-4842-8338-fc701ab2e11a. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG nova.network.neutron [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating instance_info_cache with network_info: [{"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Releasing lock "refresh_cache-15a48598-5e5d-450b-a6c5-d7637a6d8682" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:27:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-vif-unplugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] No waiting events found dispatching network-vif-unplugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-vif-unplugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Instance destroyed successfully.
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.objects.instance [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'resources' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1834940939',display_name='tempest-TestStampPattern-server-1834940939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1834940939',id=32,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA==',key_name='tempest-TestStampPattern-1893968129',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ab08f97dd54832a7cc975934b1b69f',ramdisk_id='',reservation_id='r-zf8clj6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-872060463',owner_user_name='tempest-TestStampPattern-872060463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:23:18Z,user_data=None,user_id='b8ea39d187c842788168909de203455e',uuid=15a48598-5e5d-450b-a6c5-d7637a6d8682,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converting VIF {"id": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "address": "fa:16:3e:67:85:45", "network": {"id": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b", "bridge": "br-int", "label": "tempest-TestStampPattern-811613107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab08f97dd54832a7cc975934b1b69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3c902c-c5", "ovs_interfaceid": "4e3c902c-c5f1-4842-8338-fc701ab2e11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG os_vif [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e3c902c-c5, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:27:14 user nova-compute[71689]: INFO os_vif [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:85:45,bridge_name='br-int',has_traffic_filtering=True,id=4e3c902c-c5f1-4842-8338-fc701ab2e11a,network=Network(f910e955-f75a-46aa-8d8a-ef2c21f4e98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3c902c-c5')
Apr 14 17:27:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Deleting instance files /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682_del
Apr 14 17:27:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Deletion of /opt/stack/data/nova/instances/15a48598-5e5d-450b-a6c5-d7637a6d8682_del complete
Apr 14 17:27:14 user nova-compute[71689]: INFO nova.compute.manager [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 17:27:14 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:27:14 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:15 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Took 0.54 seconds to deallocate network for instance.
Apr 14 17:27:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-vif-deleted-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:27:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:15 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Deleted allocations for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682
Apr 14 17:27:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received event network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Acquiring lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Lock "15a48598-5e5d-450b-a6c5-d7637a6d8682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] No waiting events found dispatching network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:16 user nova-compute[71689]: WARNING nova.compute.manager [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Received unexpected event network-vif-plugged-4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance with vm_state deleted and task_state None.
Apr 14 17:27:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-changed-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Refreshing instance network info cache due to event network-changed-7549a60b-8755-4baa-bf6b-6571c0cbb88b. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Acquiring lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Acquired lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Refreshing network info cache for port 7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:26 user nova-compute[71689]: INFO nova.compute.manager [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Terminating instance
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:27:26 user nova-compute[71689]: INFO nova.compute.claims [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Claim successful on node user
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updated VIF entry in instance network info cache for port 7549a60b-8755-4baa-bf6b-6571c0cbb88b. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG nova.network.neutron [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating instance_info_cache with network_info: [{"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Releasing lock "refresh_cache-15ce59e7-b263-4e0b-9f19-638db9606c7b" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Instance destroyed successfully.
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'resources' on Instance uuid 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181691319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181691319',id=15,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965bd22f61df40bd89e8ef35fb12bcd3',ramdisk_id='',reservation_id='r-pne0ekse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-995212803',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:09:47Z,user_data=None,user_id='b5c86125160643958349100fb3a7855b',uuid=4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converting VIF {"id": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "address": "fa:16:3e:d8:2f:e4", "network": {"id": "d6985162-5d80-43b0-a99f-e724ada7fdf4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-705390035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965bd22f61df40bd89e8ef35fb12bcd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca35158-a3", "ovs_interfaceid": "4ca35158-a3a3-41be-bfea-28f8bf46a796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG os_vif [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ca35158-a3, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:27:27 user nova-compute[71689]: INFO os_vif [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=4ca35158-a3a3-41be-bfea-28f8bf46a796,network=Network(d6985162-5d80-43b0-a99f-e724ada7fdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca35158-a3')
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Deleting instance files /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f_del
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Deletion of /opt/stack/data/nova/instances/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f_del complete
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.compute.manager [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Creating image(s)
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "/opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "/opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.policy [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e9c6562cb6341e1b4eeebbe95fcb981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a442e486d0ac4ac8ad8205e16f9df504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk 1073741824" returned: 0 in 0.055s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.136s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:27 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Took 0.66 seconds to deallocate network for instance.
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Cannot resize image /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lazy-loading 'migration_context' on Instance uuid 34b83ea6-ac75-48ad-b452-0e74151e1e1c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received event network-vif-deleted-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Successfully created port: 1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:28 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Deleted allocations for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received event network-vif-unplugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] No waiting events found dispatching network-vif-unplugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:28 user nova-compute[71689]: WARNING nova.compute.manager [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received unexpected event network-vif-unplugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance with vm_state deleted and task_state None.
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received event network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Acquiring lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Lock "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] No waiting events found dispatching network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:28 user nova-compute[71689]: WARNING nova.compute.manager [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Received unexpected event network-vif-plugged-4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance with vm_state deleted and task_state None.
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Successfully updated port: 1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "refresh_cache-34b83ea6-ac75-48ad-b452-0e74151e1e1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquired lock "refresh_cache-34b83ea6-ac75-48ad-b452-0e74151e1e1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-changed-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.compute.manager [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Refreshing instance network info cache due to event network-changed-1073478a-c9c5-4548-8276-ba9edb79833e. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Acquiring lock "refresh_cache-34b83ea6-ac75-48ad-b452-0e74151e1e1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:27:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Updating instance_info_cache with network_info: [{"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Releasing lock "refresh_cache-34b83ea6-ac75-48ad-b452-0e74151e1e1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Instance network_info: |[{"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Acquired lock "refresh_cache-34b83ea6-ac75-48ad-b452-0e74151e1e1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Refreshing network info cache for port 1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Start _get_guest_xml network_info=[{"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:27:29 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:27:29 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-87879708',display_name='tempest-VolumesNegativeTest-instance-87879708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-87879708',id=38,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a442e486d0ac4ac8ad8205e16f9df504',ramdisk_id='',reservation_id='r-fs92marn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1802972620',owner_user_name='tempest-VolumesNegativeTest-1802972620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:27:27Z,user_data=None,user_id='6e9c6562cb6341e1b4eeebbe95fcb981',uuid=34b83ea6-ac75-48ad-b452-0e74151e1e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Converting VIF {"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b83ea6-ac75-48ad-b452-0e74151e1e1c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:27:29 user nova-compute[71689]:   <uuid>34b83ea6-ac75-48ad-b452-0e74151e1e1c</uuid>
Apr 14 17:27:29 user nova-compute[71689]:   <name>instance-00000026</name>
Apr 14 17:27:29 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:27:29 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:27:29 user nova-compute[71689]:   <metadata>
Apr 14 17:27:29 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:27:29 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:27:29 user nova-compute[71689]:       <nova:name>tempest-VolumesNegativeTest-instance-87879708</nova:name>
Apr 14 17:27:29 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:27:29</nova:creationTime>
Apr 14 17:27:29 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:27:29 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:27:29 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:27:29 user nova-compute[71689]:       <nova:owner>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:user uuid="6e9c6562cb6341e1b4eeebbe95fcb981">tempest-VolumesNegativeTest-1802972620-project-member</nova:user>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:project uuid="a442e486d0ac4ac8ad8205e16f9df504">tempest-VolumesNegativeTest-1802972620</nova:project>
Apr 14 17:27:29 user nova-compute[71689]:       </nova:owner>
Apr 14 17:27:29 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:27:29 user nova-compute[71689]:       <nova:ports>
Apr 14 17:27:29 user nova-compute[71689]:         <nova:port uuid="1073478a-c9c5-4548-8276-ba9edb79833e">
Apr 14 17:27:29 user nova-compute[71689]:           <nova:ip type="fixed" address="192.168.233.142" ipVersion="4"/>
Apr 14 17:27:29 user nova-compute[71689]:         </nova:port>
Apr 14 17:27:29 user nova-compute[71689]:       </nova:ports>
Apr 14 17:27:29 user nova-compute[71689]:     </nova:instance>
Apr 14 17:27:29 user nova-compute[71689]:   </metadata>
Apr 14 17:27:29 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:27:29 user nova-compute[71689]:     <system>
Apr 14 17:27:29 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:27:29 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:27:29 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:27:29 user nova-compute[71689]:       <entry name="serial">34b83ea6-ac75-48ad-b452-0e74151e1e1c</entry>
Apr 14 17:27:29 user nova-compute[71689]:       <entry name="uuid">34b83ea6-ac75-48ad-b452-0e74151e1e1c</entry>
Apr 14 17:27:29 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:27:29 user nova-compute[71689]:     </system>
Apr 14 17:27:29 user nova-compute[71689]:   </sysinfo>
Apr 14 17:27:29 user nova-compute[71689]:   <os>
Apr 14 17:27:29 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:27:29 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:27:29 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:27:29 user nova-compute[71689]:   </os>
Apr 14 17:27:29 user nova-compute[71689]:   <features>
Apr 14 17:27:29 user nova-compute[71689]:     <acpi/>
Apr 14 17:27:29 user nova-compute[71689]:     <apic/>
Apr 14 17:27:29 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:27:29 user nova-compute[71689]:   </features>
Apr 14 17:27:29 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:27:29 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:27:29 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:27:29 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:27:29 user nova-compute[71689]:   </clock>
Apr 14 17:27:29 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:27:29 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:27:29 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:27:29 user nova-compute[71689]:   </cpu>
Apr 14 17:27:29 user nova-compute[71689]:   <devices>
Apr 14 17:27:29 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:27:29 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:27:29 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk"/>
Apr 14 17:27:29 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:27:29 user nova-compute[71689]:     </disk>
Apr 14 17:27:29 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:27:29 user nova-compute[71689]:       <mac address="fa:16:3e:b6:0f:da"/>
Apr 14 17:27:29 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:27:29 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:27:29 user nova-compute[71689]:       <target dev="tap1073478a-c9"/>
Apr 14 17:27:29 user nova-compute[71689]:     </interface>
Apr 14 17:27:29 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:27:29 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/console.log" append="off"/>
Apr 14 17:27:29 user nova-compute[71689]:     </serial>
Apr 14 17:27:29 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:27:29 user nova-compute[71689]:     <video>
Apr 14 17:27:29 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:27:29 user nova-compute[71689]:     </video>
Apr 14 17:27:29 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:27:29 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:27:29 user nova-compute[71689]:     </rng>
Apr 14 17:27:29 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:27:29 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:27:29 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:27:29 user nova-compute[71689]:     </memballoon>
Apr 14 17:27:29 user nova-compute[71689]:   </devices>
Apr 14 17:27:29 user nova-compute[71689]: </domain>
Apr 14 17:27:29 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-87879708',display_name='tempest-VolumesNegativeTest-instance-87879708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-87879708',id=38,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a442e486d0ac4ac8ad8205e16f9df504',ramdisk_id='',reservation_id='r-fs92marn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1802972620',owner_user_name='tempest-VolumesNegativeTest-1802972620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:27:27Z,user_data=None,user_id='6e9c6562cb6341e1b4eeebbe95fcb981',uuid=34b83ea6-ac75-48ad-b452-0e74151e1e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Converting VIF {"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG os_vif [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1073478a-c9, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1073478a-c9, col_values=(('external_ids', {'iface-id': '1073478a-c9c5-4548-8276-ba9edb79833e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:0f:da', 'vm-uuid': '34b83ea6-ac75-48ad-b452-0e74151e1e1c'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: INFO os_vif [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9')
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493234.4213717, 15a48598-5e5d-450b-a6c5-d7637a6d8682 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:29 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] VM Stopped (Lifecycle Event)
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] No VIF found with MAC fa:16:3e:b6:0f:da, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-28febaa2-0946-499c-ab56-02e649673254 None None] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Updated VIF entry in instance network info cache for port 1073478a-c9c5-4548-8276-ba9edb79833e. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Updating instance_info_cache with network_info: [{"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:29 user nova-compute[71689]: INFO nova.compute.manager [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Terminating instance
Apr 14 17:27:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Releasing lock "refresh_cache-34b83ea6-ac75-48ad-b452-0e74151e1e1c" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-vif-unplugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] No waiting events found dispatching network-vif-unplugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-vif-unplugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Acquiring lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] No waiting events found dispatching network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:30 user nova-compute[71689]: WARNING nova.compute.manager [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received unexpected event network-vif-plugged-7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance with vm_state active and task_state deleting.
Apr 14 17:27:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Instance destroyed successfully.
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.objects.instance [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'resources' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-880884795',display_name='tempest-SnapshotDataIntegrityTests-server-880884795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-880884795',id=33,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME8aoJyi0vLQ0MCxGXeBzoEE4eLG4CfEQiz1k6/xiDjKOq15pBqG+t7b9GfO5oOEKJaRgYDThOzcI9kcGOzCkBEuKkYPt0LUpXKhM6Yh6bYcd6WF1/PXpn6j5rcw/py5A==',key_name='tempest-SnapshotDataIntegrityTests-1467007685',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:20:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e3e0c3b9c7b4ca79b75def0f04f5549',ramdisk_id='',reservation_id='r-qx3j7and',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1230410658',owner_user_name='tempest-SnapshotDataIntegrityTests-1230410658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:20:50Z,user_data=None,user_id='ecae496b720c4e09b90986969d9ae9fa',uuid=15ce59e7-b263-4e0b-9f19-638db9606c7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Converting VIF {"id": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "address": "fa:16:3e:d6:23:b6", "network": {"id": "992312a0-f518-430d-b27d-32c995b50f8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-481113736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3e0c3b9c7b4ca79b75def0f04f5549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7549a60b-87", "ovs_interfaceid": "7549a60b-8755-4baa-bf6b-6571c0cbb88b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG os_vif [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7549a60b-87, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:31 user nova-compute[71689]: INFO os_vif [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:23:b6,bridge_name='br-int',has_traffic_filtering=True,id=7549a60b-8755-4baa-bf6b-6571c0cbb88b,network=Network(992312a0-f518-430d-b27d-32c995b50f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7549a60b-87')
Apr 14 17:27:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Deleting instance files /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b_del
Apr 14 17:27:31 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Deletion of /opt/stack/data/nova/instances/15ce59e7-b263-4e0b-9f19-638db9606c7b_del complete
Apr 14 17:27:31 user nova-compute[71689]: INFO nova.compute.manager [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Took 1.43 seconds to destroy the instance on the hypervisor.
Apr 14 17:27:31 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:31 user nova-compute[71689]: WARNING nova.compute.manager [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state building and task_state spawning.
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:32 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:32 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Took 1.00 seconds to deallocate network for instance.
Apr 14 17:27:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:27:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:27:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:32 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Deleted allocations for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b
Apr 14 17:27:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "15ce59e7-b263-4e0b-9f19-638db9606c7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.908s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Received event network-vif-deleted-7549a60b-8755-4baa-bf6b-6571c0cbb88b {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:33 user nova-compute[71689]: WARNING nova.compute.manager [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state building and task_state spawning.
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493253.532309, 34b83ea6-ac75-48ad-b452-0e74151e1e1c => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] VM Resumed (Lifecycle Event)
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Instance spawned successfully.
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493253.5334833, 34b83ea6-ac75-48ad-b452-0e74151e1e1c => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] VM Started (Lifecycle Event)
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Took 6.35 seconds to spawn the instance on the hypervisor.
Apr 14 17:27:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:33 user nova-compute[71689]: INFO nova.compute.manager [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Took 7.03 seconds to build instance.
Apr 14 17:27:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.133s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:27:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:27:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:27:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:27:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:27:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8289MB free_disk=26.23028564453125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Applying migration context for instance 66599df0-d961-404f-9573-fe0289019752 as it has an incoming, in-progress migration 0ef22b9f-1a39-4541-b224-166407fbfae4. Migration status is finished {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 17:27:39 user nova-compute[71689]: INFO nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating resource usage from migration 0ef22b9f-1a39-4541-b224-166407fbfae4
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Migration 0ef22b9f-1a39-4541-b224-166407fbfae4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:27:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493247.1590364, 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:42 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] VM Stopped (Lifecycle Event)
Apr 14 17:27:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c0b725c7-0666-45c0-b8bb-744cebdb5d12 None None] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:42 user nova-compute[71689]: INFO nova.compute.manager [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Terminating instance
Apr 14 17:27:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:27:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.compute.manager [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-unplugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Instance destroyed successfully.
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'resources' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1263709076',display_name='tempest-ServerRescueNegativeTestJSON-server-1263709076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1263709076',id=19,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='070c6b9f620548b183904d1971f35752',ramdisk_id='',reservation_id='r-aknh1hwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2056337871',owner_user_name='tempest-ServerRescueNegativeTestJSON-2056337871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:17:29Z,user_data=None,user_id='2434278fe61447fab1f5a930aa16a1de',uuid=a075e35f-c43c-4e3a-adb2-2e1629079d93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converting VIF {"id": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "address": "fa:16:3e:d0:76:39", "network": {"id": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-348636582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "070c6b9f620548b183904d1971f35752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1477a3d2-85", "ovs_interfaceid": "1477a3d2-85fc-4f05-83a0-156f88fc4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG os_vif [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1477a3d2-85, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:27:43 user nova-compute[71689]: INFO os_vif [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:39,bridge_name='br-int',has_traffic_filtering=True,id=1477a3d2-85fc-4f05-83a0-156f88fc4939,network=Network(c5b14da6-ae55-4be0-bbe8-7e1259cadfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1477a3d2-85')
Apr 14 17:27:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Deleting instance files /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93_del
Apr 14 17:27:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Deletion of /opt/stack/data/nova/instances/a075e35f-c43c-4e3a-adb2-2e1629079d93_del complete
Apr 14 17:27:43 user nova-compute[71689]: INFO nova.compute.manager [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 17:27:43 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:27:43 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:27:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:27:45 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Took 1.25 seconds to deallocate network for instance.
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:45 user nova-compute[71689]: WARNING nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state deleted and task_state None.
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:45 user nova-compute[71689]: WARNING nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state deleted and task_state None.
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Acquiring lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] No waiting events found dispatching network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:27:45 user nova-compute[71689]: WARNING nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received unexpected event network-vif-plugged-1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance with vm_state deleted and task_state None.
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Received event network-vif-deleted-1477a3d2-85fc-4f05-83a0-156f88fc4939 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:45 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Deleted allocations for instance a075e35f-c43c-4e3a-adb2-2e1629079d93
Apr 14 17:27:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "a075e35f-c43c-4e3a-adb2-2e1629079d93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.555s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:27:46 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493251.0152867, 15ce59e7-b263-4e0b-9f19-638db9606c7b => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:46 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] VM Stopped (Lifecycle Event)
Apr 14 17:27:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-8021f8a1-9d8a-4b68-88b5-870bb5686dbc None None] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:27:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:27:58 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493263.6528013, a075e35f-c43c-4e3a-adb2-2e1629079d93 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:27:58 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] VM Stopped (Lifecycle Event)
Apr 14 17:27:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7b0a15ad-be39-4780-8b51-3941a946676c None None] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:27:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "66599df0-d961-404f-9573-fe0289019752" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Going to confirm migration 2 {{(pid=71689) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:28:19 user nova-compute[71689]: DEBUG nova.objects.instance [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'info_cache' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'migration_context' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:28:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.283s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:20 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Deleted allocation for migration 0ef22b9f-1a39-4541-b224-166407fbfae4
Apr 14 17:28:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.407s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:28:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:28:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:28:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=26.226604461669922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:28:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:28:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:28:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:28:56 user nova-compute[71689]: INFO nova.compute.claims [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Claim successful on node user
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:28:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:28:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:28:57 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Creating image(s)
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "/opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "/opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "/opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.policy [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.162s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.146s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk 1073741824" returned: 0 in 0.054s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Successfully created port: 500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Cannot resize image /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'migration_context' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Ensure instance console log exists: /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:28:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Successfully updated port: 500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "refresh_cache-29e0fe26-16f6-47b3-858b-37ff677de04f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquired lock "refresh_cache-29e0fe26-16f6-47b3-858b-37ff677de04f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-changed-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Refreshing instance network info cache due to event network-changed-500493ce-d3d4-47c3-99dc-06c6fabf828c. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Acquiring lock "refresh_cache-29e0fe26-16f6-47b3-858b-37ff677de04f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:28:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Updating instance_info_cache with network_info: [{"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Releasing lock "refresh_cache-29e0fe26-16f6-47b3-858b-37ff677de04f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Instance network_info: |[{"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Acquired lock "refresh_cache-29e0fe26-16f6-47b3-858b-37ff677de04f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Refreshing network info cache for port 500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Start _get_guest_xml network_info=[{"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:28:59 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:28:59 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1807197706',display_name='tempest-VolumesSnapshotTestJSON-instance-1807197706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1807197706',id=39,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='360f9e856f81453b80189e456a2269fe',ramdisk_id='',reservation_id='r-lfk90fgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1090163427',owner_user_name='tempest-VolumesSnapshotTestJSON-1090163427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:28:57Z,user_data=None,user_id='f554e014a05a40c4bd070b4494314e33',uuid=29e0fe26-16f6-47b3-858b-37ff677de04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converting VIF {"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.objects.instance [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'pci_devices' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:28:59 user nova-compute[71689]:   <uuid>29e0fe26-16f6-47b3-858b-37ff677de04f</uuid>
Apr 14 17:28:59 user nova-compute[71689]:   <name>instance-00000027</name>
Apr 14 17:28:59 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:28:59 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:28:59 user nova-compute[71689]:   <metadata>
Apr 14 17:28:59 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:28:59 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:28:59 user nova-compute[71689]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1807197706</nova:name>
Apr 14 17:28:59 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:28:59</nova:creationTime>
Apr 14 17:28:59 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:28:59 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:28:59 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:28:59 user nova-compute[71689]:       <nova:owner>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:user uuid="f554e014a05a40c4bd070b4494314e33">tempest-VolumesSnapshotTestJSON-1090163427-project-member</nova:user>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:project uuid="360f9e856f81453b80189e456a2269fe">tempest-VolumesSnapshotTestJSON-1090163427</nova:project>
Apr 14 17:28:59 user nova-compute[71689]:       </nova:owner>
Apr 14 17:28:59 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:28:59 user nova-compute[71689]:       <nova:ports>
Apr 14 17:28:59 user nova-compute[71689]:         <nova:port uuid="500493ce-d3d4-47c3-99dc-06c6fabf828c">
Apr 14 17:28:59 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 17:28:59 user nova-compute[71689]:         </nova:port>
Apr 14 17:28:59 user nova-compute[71689]:       </nova:ports>
Apr 14 17:28:59 user nova-compute[71689]:     </nova:instance>
Apr 14 17:28:59 user nova-compute[71689]:   </metadata>
Apr 14 17:28:59 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:28:59 user nova-compute[71689]:     <system>
Apr 14 17:28:59 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:28:59 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:28:59 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:28:59 user nova-compute[71689]:       <entry name="serial">29e0fe26-16f6-47b3-858b-37ff677de04f</entry>
Apr 14 17:28:59 user nova-compute[71689]:       <entry name="uuid">29e0fe26-16f6-47b3-858b-37ff677de04f</entry>
Apr 14 17:28:59 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:28:59 user nova-compute[71689]:     </system>
Apr 14 17:28:59 user nova-compute[71689]:   </sysinfo>
Apr 14 17:28:59 user nova-compute[71689]:   <os>
Apr 14 17:28:59 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:28:59 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:28:59 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:28:59 user nova-compute[71689]:   </os>
Apr 14 17:28:59 user nova-compute[71689]:   <features>
Apr 14 17:28:59 user nova-compute[71689]:     <acpi/>
Apr 14 17:28:59 user nova-compute[71689]:     <apic/>
Apr 14 17:28:59 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:28:59 user nova-compute[71689]:   </features>
Apr 14 17:28:59 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:28:59 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:28:59 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:28:59 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:28:59 user nova-compute[71689]:   </clock>
Apr 14 17:28:59 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:28:59 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:28:59 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:28:59 user nova-compute[71689]:   </cpu>
Apr 14 17:28:59 user nova-compute[71689]:   <devices>
Apr 14 17:28:59 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:28:59 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:28:59 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk"/>
Apr 14 17:28:59 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:28:59 user nova-compute[71689]:     </disk>
Apr 14 17:28:59 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:28:59 user nova-compute[71689]:       <mac address="fa:16:3e:3a:1a:62"/>
Apr 14 17:28:59 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:28:59 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:28:59 user nova-compute[71689]:       <target dev="tap500493ce-d3"/>
Apr 14 17:28:59 user nova-compute[71689]:     </interface>
Apr 14 17:28:59 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:28:59 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/console.log" append="off"/>
Apr 14 17:28:59 user nova-compute[71689]:     </serial>
Apr 14 17:28:59 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:28:59 user nova-compute[71689]:     <video>
Apr 14 17:28:59 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:28:59 user nova-compute[71689]:     </video>
Apr 14 17:28:59 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:28:59 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:28:59 user nova-compute[71689]:     </rng>
Apr 14 17:28:59 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:28:59 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:28:59 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:28:59 user nova-compute[71689]:     </memballoon>
Apr 14 17:28:59 user nova-compute[71689]:   </devices>
Apr 14 17:28:59 user nova-compute[71689]: </domain>
Apr 14 17:28:59 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1807197706',display_name='tempest-VolumesSnapshotTestJSON-instance-1807197706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1807197706',id=39,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='360f9e856f81453b80189e456a2269fe',ramdisk_id='',reservation_id='r-lfk90fgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1090163427',owner_user_name='tempest-VolumesSnapshotTestJSON-1090163427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:28:57Z,user_data=None,user_id='f554e014a05a40c4bd070b4494314e33',uuid=29e0fe26-16f6-47b3-858b-37ff677de04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converting VIF {"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG os_vif [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap500493ce-d3, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap500493ce-d3, col_values=(('external_ids', {'iface-id': '500493ce-d3d4-47c3-99dc-06c6fabf828c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:1a:62', 'vm-uuid': '29e0fe26-16f6-47b3-858b-37ff677de04f'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:28:59 user nova-compute[71689]: INFO os_vif [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3')
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No VIF found with MAC fa:16:3e:3a:1a:62, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Updated VIF entry in instance network info cache for port 500493ce-d3d4-47c3-99dc-06c6fabf828c. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG nova.network.neutron [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Updating instance_info_cache with network_info: [{"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:28:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Releasing lock "refresh_cache-29e0fe26-16f6-47b3-858b-37ff677de04f" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:00 user nova-compute[71689]: DEBUG nova.compute.manager [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] No waiting events found dispatching network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:00 user nova-compute[71689]: WARNING nova.compute.manager [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received unexpected event network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c for instance with vm_state building and task_state spawning.
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493342.6356955, 29e0fe26-16f6-47b3-858b-37ff677de04f => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] VM Resumed (Lifecycle Event)
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Instance spawned successfully.
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493342.6369786, 29e0fe26-16f6-47b3-858b-37ff677de04f => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] VM Started (Lifecycle Event)
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] No waiting events found dispatching network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:02 user nova-compute[71689]: WARNING nova.compute.manager [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received unexpected event network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c for instance with vm_state building and task_state spawning.
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Took 5.73 seconds to spawn the instance on the hypervisor.
Apr 14 17:29:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:29:02 user nova-compute[71689]: INFO nova.compute.manager [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Took 6.32 seconds to build instance.
Apr 14 17:29:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.419s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:16 user nova-compute[71689]: INFO nova.compute.manager [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Terminating instance
Apr 14 17:29:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-unplugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-unplugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-unplugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Instance destroyed successfully.
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.objects.instance [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lazy-loading 'resources' on Instance uuid 34b83ea6-ac75-48ad-b452-0e74151e1e1c {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-87879708',display_name='tempest-VolumesNegativeTest-instance-87879708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-87879708',id=38,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:27:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a442e486d0ac4ac8ad8205e16f9df504',ramdisk_id='',reservation_id='r-fs92marn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1802972620',owner_user_name='tempest-VolumesNegativeTest-1802972620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:27:34Z,user_data=None,user_id='6e9c6562cb6341e1b4eeebbe95fcb981',uuid=34b83ea6-ac75-48ad-b452-0e74151e1e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Converting VIF {"id": "1073478a-c9c5-4548-8276-ba9edb79833e", "address": "fa:16:3e:b6:0f:da", "network": {"id": "c1c9ca3f-30ab-447f-9949-3eccb6476c4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81c9d4f5a6b64c7ab53336b032138aeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1073478a-c9", "ovs_interfaceid": "1073478a-c9c5-4548-8276-ba9edb79833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG os_vif [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1073478a-c9, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:29:17 user nova-compute[71689]: INFO os_vif [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0f:da,bridge_name='br-int',has_traffic_filtering=True,id=1073478a-c9c5-4548-8276-ba9edb79833e,network=Network(c1c9ca3f-30ab-447f-9949-3eccb6476c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1073478a-c9')
Apr 14 17:29:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Deleting instance files /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c_del
Apr 14 17:29:17 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Deletion of /opt/stack/data/nova/instances/34b83ea6-ac75-48ad-b452-0e74151e1e1c_del complete
Apr 14 17:29:17 user nova-compute[71689]: INFO nova.compute.manager [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 17:29:17 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:29:17 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:29:18 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Took 0.87 seconds to deallocate network for instance.
Apr 14 17:29:18 user nova-compute[71689]: DEBUG nova.compute.manager [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-deleted-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:18 user nova-compute[71689]: INFO nova.compute.manager [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Neutron deleted interface 1073478a-c9c5-4548-8276-ba9edb79833e; detaching it from the instance and deleting it from the info cache
Apr 14 17:29:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG nova.compute.manager [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Detach interface failed, port_id=1073478a-c9c5-4548-8276-ba9edb79833e, reason: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:29:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:18 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Deleted allocations for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c
Apr 14 17:29:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:19 user nova-compute[71689]: WARNING nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state deleted and task_state None.
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:19 user nova-compute[71689]: WARNING nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state deleted and task_state None.
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:19 user nova-compute[71689]: WARNING nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state deleted and task_state None.
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-unplugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-unplugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:19 user nova-compute[71689]: WARNING nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-unplugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state deleted and task_state None.
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Acquiring lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "34b83ea6-ac75-48ad-b452-0e74151e1e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] No waiting events found dispatching network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:29:19 user nova-compute[71689]: WARNING nova.compute.manager [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Received unexpected event network-vif-plugged-1073478a-c9c5-4548-8276-ba9edb79833e for instance with vm_state deleted and task_state None.
Apr 14 17:29:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:32 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493357.5872872, 34b83ea6-ac75-48ad-b452-0e74151e1e1c => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:29:32 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] VM Stopped (Lifecycle Event)
Apr 14 17:29:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c0c705a6-3d9e-412c-acac-a0606fab460f None None] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:29:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:36 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:29:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:29:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:29:36 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [{"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-66599df0-d961-404f-9573-fe0289019752" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:29:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:29:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:29:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:29:39 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=26.215145111083984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 29e0fe26-16f6-47b3-858b-37ff677de04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:29:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:29:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:29:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:29:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:29:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:03 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:30:03 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:30:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:09 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:30:10 user nova-compute[71689]: INFO nova.compute.manager [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Get console output
Apr 14 17:30:10 user nova-compute[71689]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 17:30:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:30:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:30:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:30:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:30:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:30:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:30:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:30:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:40 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:41 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:30:41 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8565MB free_disk=26.20563507080078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 66599df0-d961-404f-9573-fe0289019752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 29e0fe26-16f6-47b3-858b-37ff677de04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:30:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "66599df0-d961-404f-9573-fe0289019752" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "66599df0-d961-404f-9573-fe0289019752" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "66599df0-d961-404f-9573-fe0289019752" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG nova.objects.instance [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'flavor' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:30:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Ignoring supplied device name: /dev/vdb
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:30:46 user nova-compute[71689]: INFO nova.compute.manager [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Attaching volume 1ecf5830-3453-486f-a955-3097272aa198 to /dev/vdb
Apr 14 17:30:46 user nova-compute[71689]: DEBUG os_brick.utils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ad2b7-076b-4b8b-b607-b74637e9c46f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[738f49ee-d047-45c0-9c5b-e17b939b79a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4420db1-158a-4af7-a049-dc0df141560d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7bba22-ecb8-4116-b426-2a76986a46c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:30:47 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:30:47 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab40eae-5a07-4c5f-8a69-3bf447901595]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG os_brick.utils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Updating existing volume attachment record: 002f7818-31eb-4205-8879-b2ed5099723c {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:30:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqeLzSCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:30:51 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:30:51 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:30:51 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6483d2a-ca28-476b-ba34-b3fda8834bbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:30:51 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3bec8-75d2-4da2-9cab-6afc9f705eea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198] added
Apr 14 17:30:51 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba0504-610a-4a74-bb42-543921bfadad]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd96efa-1896-459c-af40-ba67fd567854]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqeLzSCc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqeLzSCc" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee2b02d-131c-4d27-8f3c-9fb8fc23c813]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZqeLzSCc'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:51 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.198s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f2a57a-dcf5-4aff-b871-0177fb19e2ed]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f9b8c8-8ab8-44df-a9ba-ddefaa99a7aa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:30:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:30:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[82099e94-fabb-4e72-b9f5-595783f7e157]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260]
Apr 14 17:30:52 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260] successful.
Apr 14 17:30:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe10db1-6d1d-4415-a807-2111914d4ced]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5980e973-5bb5-4d51-907f-c7e0b2daad41]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:30:52 user nova-compute[71689]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)
Apr 14 17:30:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:30:52 user nova-compute[71689]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)
Apr 14 17:30:52 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d9efc-0ee2-4b3c-94d5-c6cc1ce2039f]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqeLzSCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23262306331666461', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262306331666461', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'flavor' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:30:53 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:30:53 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:30:53 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:30:53 user nova-compute[71689]:   <serial>1ecf5830-3453-486f-a955-3097272aa198</serial>
Apr 14 17:30:53 user nova-compute[71689]: </disk>
Apr 14 17:30:53 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No VIF found with MAC fa:16:3e:3a:1a:62, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:30:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.008s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:30:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:31:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:31:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:31:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "66599df0-d961-404f-9573-fe0289019752" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:11 user nova-compute[71689]: INFO nova.compute.manager [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Terminating instance
Apr 14 17:31:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-unplugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-unplugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.compute.manager [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-unplugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Instance destroyed successfully.
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.objects.instance [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 66599df0-d961-404f-9573-fe0289019752 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1884229091',display_name='tempest-ServerActionsTestJSON-server-1884229091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1884229091',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-hy00qi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:28:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=66599df0-d961-404f-9573-fe0289019752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "b85a290c-1e7e-4f74-8590-be96f453decf", "address": "fa:16:3e:95:4c:87", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85a290c-1e", "ovs_interfaceid": "b85a290c-1e7e-4f74-8590-be96f453decf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_vif [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb85a290c-1e, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:12 user nova-compute[71689]: INFO os_vif [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:87,bridge_name='br-int',has_traffic_filtering=True,id=b85a290c-1e7e-4f74-8590-be96f453decf,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85a290c-1e')
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxqGBiVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:31:12 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[130179f6-97d0-4009-b187-5829bb1462c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:31:12 user nova-compute[71689]: No targets found.
Apr 14 17:31:12 user nova-compute[71689]: iSNS:
Apr 14 17:31:12 user nova-compute[71689]: No targets found.
Apr 14 17:31:12 user nova-compute[71689]: STATIC:
Apr 14 17:31:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198
Apr 14 17:31:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:31:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:31:12 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87
Apr 14 17:31:12 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:31:12 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:31:12 user nova-compute[71689]: FIRMWARE:
Apr 14 17:31:12 user nova-compute[71689]: No targets found.
Apr 14 17:31:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:31:12 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:31:12 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d247293-6ee0-43c5-8c4d-e2e3ef62903b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e641f35-3c16-4ec4-9b1b-1c4cd47b8d22]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:31:12 user nova-compute[71689]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)
Apr 14 17:31:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 (non-flash)
Apr 14 17:31:12 user nova-compute[71689]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)
Apr 14 17:31:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c3555a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[50800b66-3eae-49fa-a1d9-105be2a3a9dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd398903-bb0c-4025-9764-41165c6dae42]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf352769-011c-4e3d-b1d4-67a168935def]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0d1ff6-a5be-46d1-b403-f2cf3a21710d]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416d480-fe87-4c77-954e-0f0d9a3be9e4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f0ce1-ba9a-4bd3-a2de-e5ddb747d800]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260]
Apr 14 17:31:12 user nova-compute[71689]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87, portal: 172.16.0.220,3260] successful.
Apr 14 17:31:12 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f629cce-a595-45d8-9afe-0f617ea75a87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b184c78-a22c-4862-931a-21a76c25c0be]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] <== disconnect_volume: return (320ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:31:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Deleting instance files /opt/stack/data/nova/instances/66599df0-d961-404f-9573-fe0289019752_del
Apr 14 17:31:12 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Deletion of /opt/stack/data/nova/instances/66599df0-d961-404f-9573-fe0289019752_del complete
Apr 14 17:31:12 user nova-compute[71689]: INFO nova.compute.manager [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 17:31:12 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:31:12 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 66599df0-d961-404f-9573-fe0289019752] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:31:13 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:31:13 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 66599df0-d961-404f-9573-fe0289019752] Took 1.11 seconds to deallocate network for instance.
Apr 14 17:31:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-deleted-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:14 user nova-compute[71689]: INFO nova.compute.manager [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Detaching volume 1ecf5830-3453-486f-a955-3097272aa198
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Acquiring lock "66599df0-d961-404f-9573-fe0289019752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Lock "66599df0-d961-404f-9573-fe0289019752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] No waiting events found dispatching network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:31:14 user nova-compute[71689]: WARNING nova.compute.manager [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] [instance: 66599df0-d961-404f-9573-fe0289019752] Received unexpected event network-vif-plugged-b85a290c-1e7e-4f74-8590-be96f453decf for instance with vm_state active and task_state deleting.
Apr 14 17:31:14 user nova-compute[71689]: INFO nova.virt.block_device [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Attempting to driver detach volume 1ecf5830-3453-486f-a955-3097272aa198 from mountpoint /dev/vdb
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Attempting to detach device vdb from instance 29e0fe26-16f6-47b3-858b-37ff677de04f from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:31:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:31:14 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:31:14 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:31:14 user nova-compute[71689]:   <serial>1ecf5830-3453-486f-a955-3097272aa198</serial>
Apr 14 17:31:14 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:31:14 user nova-compute[71689]: </disk>
Apr 14 17:31:14 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:31:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully detached device vdb from instance 29e0fe26-16f6-47b3-858b-37ff677de04f from the persistent domain config.
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29e0fe26-16f6-47b3-858b-37ff677de04f from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:31:14 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:31:14 user nova-compute[71689]:   <source dev="/dev/sdc"/>
Apr 14 17:31:14 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:31:14 user nova-compute[71689]:   <serial>1ecf5830-3453-486f-a955-3097272aa198</serial>
Apr 14 17:31:14 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:31:14 user nova-compute[71689]: </disk>
Apr 14 17:31:14 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:14 user nova-compute[71689]: INFO nova.compute.manager [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Deleting volume: 6f629cce-a595-45d8-9afe-0f617ea75a87 {{(pid=71689) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493474.686658, 29e0fe26-16f6-47b3-858b-37ff677de04f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:31:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully detached device vdb from instance 29e0fe26-16f6-47b3-858b-37ff677de04f from the live domain config.
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqeLzSCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:31:14 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ee224-8c92-43c2-b2bd-7218cd60b049]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:31:14 user nova-compute[71689]: No targets found.
Apr 14 17:31:14 user nova-compute[71689]: iSNS:
Apr 14 17:31:14 user nova-compute[71689]: No targets found.
Apr 14 17:31:14 user nova-compute[71689]: STATIC:
Apr 14 17:31:14 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198
Apr 14 17:31:14 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:31:14 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:31:14 user nova-compute[71689]: FIRMWARE:
Apr 14 17:31:14 user nova-compute[71689]: No targets found.
Apr 14 17:31:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:31:14 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:31:14 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d740a5-a329-4328-9395-63d294a82119]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25d4681-455d-4005-9049-027c1310e4b9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)
Apr 14 17:31:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 (non-flash)
Apr 14 17:31:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c222050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[42825cea-65fe-4174-bb15-a2c59a6578fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[68430da4-95f0-4451-a75d-f8e9bab72a14]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5c7ee-ef38-4ced-8678-196f617f38ec]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdb1df2-81b2-4343-9497-1cd52996ff61]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae6c9b-2325-49d2-bddc-7b81070ae290]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:14 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Deleted allocations for instance 66599df0-d961-404f-9573-fe0289019752
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b351d-0762-43bd-8a53-a6e2f2b3fd26]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260]
Apr 14 17:31:14 user nova-compute[71689]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198, portal: 172.16.0.220,3260] successful.
Apr 14 17:31:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:31:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875cc51-8df5-4239-a19a-a73f01e8456d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== disconnect_volume: return (310ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "66599df0-d961-404f-9573-fe0289019752" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.518s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'flavor' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.738s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.618s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:15 user nova-compute[71689]: INFO nova.compute.manager [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Terminating instance
Apr 14 17:31:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:31:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-vif-unplugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] No waiting events found dispatching network-vif-unplugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-vif-unplugged-500493ce-d3d4-47c3-99dc-06c6fabf828c for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Instance destroyed successfully.
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'resources' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1807197706',display_name='tempest-VolumesSnapshotTestJSON-instance-1807197706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1807197706',id=39,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:29:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='360f9e856f81453b80189e456a2269fe',ramdisk_id='',reservation_id='r-lfk90fgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1090163427',owner_user_name='tempest-VolumesSnapshotTestJSON-1090163427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:29:03Z,user_data=None,user_id='f554e014a05a40c4bd070b4494314e33',uuid=29e0fe26-16f6-47b3-858b-37ff677de04f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converting VIF {"id": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "address": "fa:16:3e:3a:1a:62", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500493ce-d3", "ovs_interfaceid": "500493ce-d3d4-47c3-99dc-06c6fabf828c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_vif [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap500493ce-d3, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:16 user nova-compute[71689]: INFO os_vif [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1a:62,bridge_name='br-int',has_traffic_filtering=True,id=500493ce-d3d4-47c3-99dc-06c6fabf828c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500493ce-d3')
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:1ecf5830-3453-486f-a955-3097272aa198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqeLzSCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:31:16 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2b779e13-8424-4d29-bcf0-e2bdb77c3890]: Unexpected error while running command.
Apr 14 17:31:16 user nova-compute[71689]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:31:16 user nova-compute[71689]: Exit code: 21
Apr 14 17:31:16 user nova-compute[71689]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:31:16 user nova-compute[71689]: Stderr: '' {{(pid=81988) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 17:31:16 user nova-compute[71689]: Traceback (most recent call last):
Apr 14 17:31:16 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 17:31:16 user nova-compute[71689]:     ret = func(*f_args, **f_kwargs)
Apr 14 17:31:16 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 17:31:16 user nova-compute[71689]:     return func(*args, **kwargs)
Apr 14 17:31:16 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 17:31:16 user nova-compute[71689]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 17:31:16 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 17:31:16 user nova-compute[71689]:     return putils.execute(on_execute=on_execute,
Apr 14 17:31:16 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 17:31:16 user nova-compute[71689]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 17:31:16 user nova-compute[71689]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 17:31:16 user nova-compute[71689]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:31:16 user nova-compute[71689]: Exit code: 21
Apr 14 17:31:16 user nova-compute[71689]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:31:16 user nova-compute[71689]: Stderr: ''
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b779e13-8424-4d29-bcf0-e2bdb77c3890]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 17:31:16 user nova-compute[71689]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:31:16 user nova-compute[71689]: Exit code: 21
Apr 14 17:31:16 user nova-compute[71689]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:31:16 user nova-compute[71689]: Stderr: ''
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 17:31:16 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71689) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== disconnect_volume: return (36ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:31:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Deleting instance files /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f_del
Apr 14 17:31:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Deletion of /opt/stack/data/nova/instances/29e0fe26-16f6-47b3-858b-37ff677de04f_del complete
Apr 14 17:31:16 user nova-compute[71689]: INFO nova.compute.manager [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 17:31:16 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:31:16 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:31:17 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:31:17 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Took 0.65 seconds to deallocate network for instance.
Apr 14 17:31:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-vif-deleted-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:31:17 user nova-compute[71689]: WARNING nova.volume.cinder [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Attachment 002f7818-31eb-4205-8879-b2ed5099723c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 002f7818-31eb-4205-8879-b2ed5099723c. (HTTP 404) (Request-ID: req-2447a307-95a7-4890-b4c6-41a8e22777ec)
Apr 14 17:31:17 user nova-compute[71689]: INFO nova.compute.manager [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 17:31:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:17 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:31:17 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:31:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:17 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Deleted allocations for instance 29e0fe26-16f6-47b3-858b-37ff677de04f
Apr 14 17:31:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:18 user nova-compute[71689]: DEBUG nova.compute.manager [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received event network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:31:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Acquiring lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Lock "29e0fe26-16f6-47b3-858b-37ff677de04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:18 user nova-compute[71689]: DEBUG nova.compute.manager [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] No waiting events found dispatching network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:31:18 user nova-compute[71689]: WARNING nova.compute.manager [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Received unexpected event network-vif-plugged-500493ce-d3d4-47c3-99dc-06c6fabf828c for instance with vm_state deleted and task_state None.
Apr 14 17:31:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:27 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493472.3045146, 66599df0-d961-404f-9573-fe0289019752 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:31:27 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 66599df0-d961-404f-9573-fe0289019752] VM Stopped (Lifecycle Event)
Apr 14 17:31:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-73691951-33b9-431a-87e3-2840dbdead06 None None] [instance: 66599df0-d961-404f-9573-fe0289019752] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:31:31 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493476.5651398, 29e0fe26-16f6-47b3-858b-37ff677de04f => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:31:31 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] VM Stopped (Lifecycle Event)
Apr 14 17:31:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-dfa91a16-5a13-40c4-b24c-baf4d38151b7 None None] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:31:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [{"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:31:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:31:39 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:41 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:31:41 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:31:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=26.22229766845703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:31:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:31:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:31:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:31:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:31:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:31:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:31:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:31:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:31:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:32:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:02 user nova-compute[71689]: INFO nova.compute.manager [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Terminating instance
Apr 14 17:32:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-vif-unplugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] No waiting events found dispatching network-vif-unplugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:32:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-vif-unplugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Instance destroyed successfully.
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.objects.instance [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'resources' on Instance uuid 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-840202433',display_name='tempest-ServerActionsTestJSON-server-840202433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-840202433',id=34,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg==',key_name='tempest-keypair-310941958',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='978cd1b4b6434b298731b01dac02591c',ramdisk_id='',reservation_id='r-65dp0ch9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2079488933',owner_user_name='tempest-ServerActionsTestJSON-2079488933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a22398c18fcc48aca2f0f9691f1c1143',uuid=4ce9811b-8c03-4a32-bfb0-5c9bc5867e88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converting VIF {"id": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "address": "fa:16:3e:0f:7a:22", "network": {"id": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-107397503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "978cd1b4b6434b298731b01dac02591c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6f2e44-80", "ovs_interfaceid": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG os_vif [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff6f2e44-80, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:32:03 user nova-compute[71689]: INFO os_vif [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=ff6f2e44-8051-46b5-9b63-46b5fcc6db6a,network=Network(187c0a7b-9043-4eac-8ad7-2c72b6f23d4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6f2e44-80')
Apr 14 17:32:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Deleting instance files /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88_del
Apr 14 17:32:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Deletion of /opt/stack/data/nova/instances/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88_del complete
Apr 14 17:32:03 user nova-compute[71689]: INFO nova.compute.manager [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 17:32:03 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:32:03 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Took 0.74 seconds to deallocate network for instance.
Apr 14 17:32:03 user nova-compute[71689]: DEBUG nova.compute.manager [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-vif-deleted-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:04 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Deleted allocations for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received event network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Acquiring lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Lock "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] No waiting events found dispatching network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:32:04 user nova-compute[71689]: WARNING nova.compute.manager [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Received unexpected event network-vif-plugged-ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance with vm_state deleted and task_state None.
Apr 14 17:32:06 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:32:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:32:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:32:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:32:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:18 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493523.1049771, 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:32:18 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] VM Stopped (Lifecycle Event)
Apr 14 17:32:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-335357db-90b3-4387-b91a-67c1a2957fb1 None None] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:32:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:32:19 user nova-compute[71689]: INFO nova.compute.claims [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Claim successful on node user
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:32:19 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.policy [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:32:19 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Creating image(s)
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "/opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "/opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "/opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.134s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.137s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk 1073741824 {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350,backing_fmt=raw /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk 1073741824" returned: 0 in 0.050s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "74274782a0a3f9f7156c90a86dd7754ff4c42350" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350 --force-share --output=json" returned: 0 in 0.131s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk. size=1073741824 {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 17:32:19 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.virt.disk.api [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Cannot resize image /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk to a smaller size. {{(pid=71689) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.objects.instance [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'migration_context' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Successfully created port: 8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Created local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Ensure instance console log exists: /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Successfully updated port: 8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquired lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-changed-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Refreshing instance network info cache due to event network-changed-8099356e-819f-4d82-8d19-38637909cf0c. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:32:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Acquiring lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating instance_info_cache with network_info: [{"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Releasing lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Instance network_info: |[{"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Acquired lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.neutron [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Refreshing network info cache for port 8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Start _get_guest_xml network_info=[{"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b0124a46-3c94-42d9-9961-82730022fc5b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:32:21 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:32:21 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T16:59:40Z,direct_url=<?>,disk_format='qcow2',id=b0124a46-3c94-42d9-9961-82730022fc5b,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='81c9d4f5a6b64c7ab53336b032138aeb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1637085239',display_name='tempest-VolumesSnapshotTestJSON-instance-1637085239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1637085239',id=40,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='360f9e856f81453b80189e456a2269fe',ramdisk_id='',reservation_id='r-b88ou5bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1090163427',owner_user_name='tempest-VolumesSnapshotTestJSON-1090163427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:32:19Z,user_data=None,user_id='f554e014a05a40c4bd070b4494314e33',uuid=abe0d33a-5e2f-4b27-b79f-a1e934e7db49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converting VIF {"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.objects.instance [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'pci_devices' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:32:21 user nova-compute[71689]:   <uuid>abe0d33a-5e2f-4b27-b79f-a1e934e7db49</uuid>
Apr 14 17:32:21 user nova-compute[71689]:   <name>instance-00000028</name>
Apr 14 17:32:21 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:32:21 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:32:21 user nova-compute[71689]:   <metadata>
Apr 14 17:32:21 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:32:21 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:32:21 user nova-compute[71689]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1637085239</nova:name>
Apr 14 17:32:21 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:32:21</nova:creationTime>
Apr 14 17:32:21 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:32:21 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:32:21 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:32:21 user nova-compute[71689]:       <nova:owner>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:user uuid="f554e014a05a40c4bd070b4494314e33">tempest-VolumesSnapshotTestJSON-1090163427-project-member</nova:user>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:project uuid="360f9e856f81453b80189e456a2269fe">tempest-VolumesSnapshotTestJSON-1090163427</nova:project>
Apr 14 17:32:21 user nova-compute[71689]:       </nova:owner>
Apr 14 17:32:21 user nova-compute[71689]:       <nova:root type="image" uuid="b0124a46-3c94-42d9-9961-82730022fc5b"/>
Apr 14 17:32:21 user nova-compute[71689]:       <nova:ports>
Apr 14 17:32:21 user nova-compute[71689]:         <nova:port uuid="8099356e-819f-4d82-8d19-38637909cf0c">
Apr 14 17:32:21 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:32:21 user nova-compute[71689]:         </nova:port>
Apr 14 17:32:21 user nova-compute[71689]:       </nova:ports>
Apr 14 17:32:21 user nova-compute[71689]:     </nova:instance>
Apr 14 17:32:21 user nova-compute[71689]:   </metadata>
Apr 14 17:32:21 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:32:21 user nova-compute[71689]:     <system>
Apr 14 17:32:21 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:32:21 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:32:21 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:32:21 user nova-compute[71689]:       <entry name="serial">abe0d33a-5e2f-4b27-b79f-a1e934e7db49</entry>
Apr 14 17:32:21 user nova-compute[71689]:       <entry name="uuid">abe0d33a-5e2f-4b27-b79f-a1e934e7db49</entry>
Apr 14 17:32:21 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:32:21 user nova-compute[71689]:     </system>
Apr 14 17:32:21 user nova-compute[71689]:   </sysinfo>
Apr 14 17:32:21 user nova-compute[71689]:   <os>
Apr 14 17:32:21 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:32:21 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:32:21 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:32:21 user nova-compute[71689]:   </os>
Apr 14 17:32:21 user nova-compute[71689]:   <features>
Apr 14 17:32:21 user nova-compute[71689]:     <acpi/>
Apr 14 17:32:21 user nova-compute[71689]:     <apic/>
Apr 14 17:32:21 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:32:21 user nova-compute[71689]:   </features>
Apr 14 17:32:21 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:32:21 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:32:21 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:32:21 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:32:21 user nova-compute[71689]:   </clock>
Apr 14 17:32:21 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:32:21 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:32:21 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:32:21 user nova-compute[71689]:   </cpu>
Apr 14 17:32:21 user nova-compute[71689]:   <devices>
Apr 14 17:32:21 user nova-compute[71689]:     <disk type="file" device="disk">
Apr 14 17:32:21 user nova-compute[71689]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 17:32:21 user nova-compute[71689]:       <source file="/opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk"/>
Apr 14 17:32:21 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:32:21 user nova-compute[71689]:     </disk>
Apr 14 17:32:21 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:32:21 user nova-compute[71689]:       <mac address="fa:16:3e:4a:8a:05"/>
Apr 14 17:32:21 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:32:21 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:32:21 user nova-compute[71689]:       <target dev="tap8099356e-81"/>
Apr 14 17:32:21 user nova-compute[71689]:     </interface>
Apr 14 17:32:21 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:32:21 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/console.log" append="off"/>
Apr 14 17:32:21 user nova-compute[71689]:     </serial>
Apr 14 17:32:21 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:32:21 user nova-compute[71689]:     <video>
Apr 14 17:32:21 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:32:21 user nova-compute[71689]:     </video>
Apr 14 17:32:21 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:32:21 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:32:21 user nova-compute[71689]:     </rng>
Apr 14 17:32:21 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:32:21 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:32:21 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:32:21 user nova-compute[71689]:     </memballoon>
Apr 14 17:32:21 user nova-compute[71689]:   </devices>
Apr 14 17:32:21 user nova-compute[71689]: </domain>
Apr 14 17:32:21 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1637085239',display_name='tempest-VolumesSnapshotTestJSON-instance-1637085239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1637085239',id=40,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='360f9e856f81453b80189e456a2269fe',ramdisk_id='',reservation_id='r-b88ou5bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1090163427',owner_user_name='tempest-VolumesSnapshotTestJSON-1090163427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:32:19Z,user_data=None,user_id='f554e014a05a40c4bd070b4494314e33',uuid=abe0d33a-5e2f-4b27-b79f-a1e934e7db49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converting VIF {"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG os_vif [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8099356e-81, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8099356e-81, col_values=(('external_ids', {'iface-id': '8099356e-819f-4d82-8d19-38637909cf0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:8a:05', 'vm-uuid': 'abe0d33a-5e2f-4b27-b79f-a1e934e7db49'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:21 user nova-compute[71689]: INFO os_vif [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81')
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No VIF found with MAC fa:16:3e:4a:8a:05, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.neutron [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updated VIF entry in instance network info cache for port 8099356e-819f-4d82-8d19-38637909cf0c. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG nova.network.neutron [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating instance_info_cache with network_info: [{"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:32:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Releasing lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:32:22 user nova-compute[71689]: WARNING nova.compute.manager [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state building and task_state spawning.
Apr 14 17:32:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:32:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:32:24 user nova-compute[71689]: WARNING nova.compute.manager [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state building and task_state spawning.
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493545.0364106, abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] VM Resumed (Lifecycle Event)
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Instance spawned successfully.
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493545.038444, abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] VM Started (Lifecycle Event)
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Took 6.00 seconds to spawn the instance on the hypervisor.
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:32:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:32:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:25 user nova-compute[71689]: INFO nova.compute.manager [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Took 6.48 seconds to build instance.
Apr 14 17:32:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.583s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:32:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating instance_info_cache with network_info: [{"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:32:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:32:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:32:41 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:32:41 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:32:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=26.221572875976562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:32:41 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:32:42 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:32:42 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:32:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:32:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:32:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:32:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:32:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:33:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:33:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:33:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:33:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:33:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:33:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating instance_info_cache with network_info: [{"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-abe0d33a-5e2f-4b27-b79f-a1e934e7db49" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:33:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:33:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:33:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=26.218708038330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:33:42 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:33:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:33:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:33:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:34:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'flavor' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:34:09 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Ignoring supplied device name: /dev/vdb
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:09 user nova-compute[71689]: INFO nova.compute.manager [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Attaching volume b28c7519-216f-4aba-a95b-7bc2694a97c8 to /dev/vdb
Apr 14 17:34:09 user nova-compute[71689]: DEBUG os_brick.utils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20f893-90e3-4fcf-8ec0-dd66232dec1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc0ed9-cd63-46a0-89a7-bc01013d54bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf884f0e-7090-4509-b47d-bcdb540624ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ffd8f5-0062-4d34-b4af-b54e2bb662aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:34:09 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:34:09 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc79216-8a8a-4baa-9680-05ff1a6f805b]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG os_brick.utils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:34:09 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating existing volume attachment record: df2af797-4534-428c-ba23-0dc1fde9aa26 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:34:11 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzNQrMqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:34:14 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:34:14 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:34:14 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e468b8-a386-4e40-b473-b7da3a42939f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:34:14 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d12f10-4c92-456f-a422-ea9b75192cd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8] added
Apr 14 17:34:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.073s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7535e12b-fd8f-4c30-833e-6e7b9e7af103]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[29345dba-99ac-4d8f-8934-528c2fafd1d6]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fzNQrMqS {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fzNQrMqS" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4315680-cf25-48b7-b4db-d3b8f84ea377]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fzNQrMqS'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f5ac8-83ae-4efe-aadc-c8ecd33abc06]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda8438-bf54-45e5-b55e-ed6f513627e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:34:14 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:34:14 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:34:14 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:34:14 user nova-compute[71689]: 
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[392644f5-a904-49d6-a1c1-7d23eed57123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260]
Apr 14 17:34:14 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260] successful.
Apr 14 17:34:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafeba60-3787-4076-815e-daa62997d169]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dc1dd5-f2b7-4754-a197-7a558e99b6d3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 (non-flash)
Apr 14 17:34:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 (non-flash)
Apr 14 17:34:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6aec8e-d5f0-46ab-8597-a5550b405b20]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:34:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzNQrMqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:34:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:34:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26139323832663935', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:34:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139323832663935', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:34:15 user nova-compute[71689]: DEBUG nova.objects.instance [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'flavor' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:34:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 17:34:15 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:34:15 user nova-compute[71689]:   <source dev="/dev/sdb"/>
Apr 14 17:34:15 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:34:15 user nova-compute[71689]:   <serial>b28c7519-216f-4aba-a95b-7bc2694a97c8</serial>
Apr 14 17:34:15 user nova-compute[71689]: </disk>
Apr 14 17:34:15 user nova-compute[71689]:  {{(pid=71689) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 17:34:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:34:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:34:16 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] No VIF found with MAC fa:16:3e:4a:8a:05, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:34:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.863s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:33 user nova-compute[71689]: INFO nova.compute.manager [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Detaching volume b28c7519-216f-4aba-a95b-7bc2694a97c8
Apr 14 17:34:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:33 user nova-compute[71689]: INFO nova.virt.block_device [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Attempting to driver detach volume b28c7519-216f-4aba-a95b-7bc2694a97c8 from mountpoint /dev/vdb
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Attempting to detach device vdb from instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 from the persistent domain config. {{(pid=71689) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:34:33 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:34:33 user nova-compute[71689]:   <source dev="/dev/sdb"/>
Apr 14 17:34:33 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:34:33 user nova-compute[71689]:   <serial>b28c7519-216f-4aba-a95b-7bc2694a97c8</serial>
Apr 14 17:34:33 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:34:33 user nova-compute[71689]: </disk>
Apr 14 17:34:33 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:34:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully detached device vdb from instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 from the persistent domain config.
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 from the live domain config. {{(pid=71689) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.guest [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 17:34:33 user nova-compute[71689]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:34:33 user nova-compute[71689]:   <source dev="/dev/sdb"/>
Apr 14 17:34:33 user nova-compute[71689]:   <target dev="vdb" bus="virtio"/>
Apr 14 17:34:33 user nova-compute[71689]:   <serial>b28c7519-216f-4aba-a95b-7bc2694a97c8</serial>
Apr 14 17:34:33 user nova-compute[71689]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 17:34:33 user nova-compute[71689]: </disk>
Apr 14 17:34:33 user nova-compute[71689]:  {{(pid=71689) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Received event <DeviceRemovedEvent: 1681493673.9750159, abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71689) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 17:34:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully detached device vdb from instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 from the live domain config.
Apr 14 17:34:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzNQrMqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:34:33 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:34:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:34:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0f822a-dc98-4478-a1c5-78891aa5a864]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:34:34 user nova-compute[71689]: No targets found.
Apr 14 17:34:34 user nova-compute[71689]: iSNS:
Apr 14 17:34:34 user nova-compute[71689]: No targets found.
Apr 14 17:34:34 user nova-compute[71689]: STATIC:
Apr 14 17:34:34 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8
Apr 14 17:34:34 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:34:34 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:34:34 user nova-compute[71689]: FIRMWARE:
Apr 14 17:34:34 user nova-compute[71689]: No targets found.
Apr 14 17:34:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:34:34 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:34:34 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be49a3-c37e-42a8-b563-d0477460e718]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bb9cf9-52a7-46bf-879b-3b44230c67ff]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 (non-flash)
Apr 14 17:34:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 (non-flash)
Apr 14 17:34:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b5945c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd77bf56-f475-4983-a36b-f6bdf2b7cd16]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab8e5f-d25e-454b-bf4f-8a7edc51cabc]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3241ad0c-9857-4173-990e-078ff759f2f0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3cce9d-e6f4-4fd8-a48e-564730dbc349]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ccda6-1d71-4db3-8478-bd0e17faf09c]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28640bc2-f61d-48b7-812f-86d7b0582dc9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260]
Apr 14 17:34:34 user nova-compute[71689]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8, portal: 172.16.0.220,3260] successful.
Apr 14 17:34:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aca9f7-6a8b-4e72-b370-dcdec5ff263b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== disconnect_volume: return (300ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:34:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'flavor' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.634s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:35 user nova-compute[71689]: INFO nova.compute.manager [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Terminating instance
Apr 14 17:34:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-unplugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-unplugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG nova.compute.manager [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-unplugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:36 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Instance destroyed successfully.
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.objects.instance [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'resources' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1637085239',display_name='tempest-VolumesSnapshotTestJSON-instance-1637085239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1637085239',id=40,image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='360f9e856f81453b80189e456a2269fe',ramdisk_id='',reservation_id='r-b88ou5bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0124a46-3c94-42d9-9961-82730022fc5b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1090163427',owner_user_name='tempest-VolumesSnapshotTestJSON-1090163427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:32:25Z,user_data=None,user_id='f554e014a05a40c4bd070b4494314e33',uuid=abe0d33a-5e2f-4b27-b79f-a1e934e7db49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converting VIF {"id": "8099356e-819f-4d82-8d19-38637909cf0c", "address": "fa:16:3e:4a:8a:05", "network": {"id": "777a6d32-2983-4b6e-844a-655be73af980", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-115342372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "360f9e856f81453b80189e456a2269fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8099356e-81", "ovs_interfaceid": "8099356e-819f-4d82-8d19-38637909cf0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_vif [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8099356e-81, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:34:36 user nova-compute[71689]: INFO os_vif [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:8a:05,bridge_name='br-int',has_traffic_filtering=True,id=8099356e-819f-4d82-8d19-38637909cf0c,network=Network(777a6d32-2983-4b6e-844a-655be73af980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8099356e-81')
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:b28c7519-216f-4aba-a95b-7bc2694a97c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzNQrMqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:34:36 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[dd309523-d82a-405c-8f5d-ab1ca1936c13]: Unexpected error while running command.
Apr 14 17:34:36 user nova-compute[71689]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:34:36 user nova-compute[71689]: Exit code: 21
Apr 14 17:34:36 user nova-compute[71689]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:34:36 user nova-compute[71689]: Stderr: '' {{(pid=81988) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 17:34:36 user nova-compute[71689]: Traceback (most recent call last):
Apr 14 17:34:36 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 17:34:36 user nova-compute[71689]:     ret = func(*f_args, **f_kwargs)
Apr 14 17:34:36 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 17:34:36 user nova-compute[71689]:     return func(*args, **kwargs)
Apr 14 17:34:36 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 17:34:36 user nova-compute[71689]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 17:34:36 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 17:34:36 user nova-compute[71689]:     return putils.execute(on_execute=on_execute,
Apr 14 17:34:36 user nova-compute[71689]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 17:34:36 user nova-compute[71689]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 17:34:36 user nova-compute[71689]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 17:34:36 user nova-compute[71689]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:34:36 user nova-compute[71689]: Exit code: 21
Apr 14 17:34:36 user nova-compute[71689]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:34:36 user nova-compute[71689]: Stderr: ''
Apr 14 17:34:36 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd309523-d82a-405c-8f5d-ab1ca1936c13]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 17:34:36 user nova-compute[71689]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:34:36 user nova-compute[71689]: Exit code: 21
Apr 14 17:34:36 user nova-compute[71689]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:34:36 user nova-compute[71689]: Stderr: ''
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 17:34:36 user nova-compute[71689]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71689) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] <== disconnect_volume: return (30ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:34:36 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Deleting instance files /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49_del
Apr 14 17:34:36 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Deletion of /opt/stack/data/nova/instances/abe0d33a-5e2f-4b27-b79f-a1e934e7db49_del complete
Apr 14 17:34:36 user nova-compute[71689]: INFO nova.compute.manager [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Took 1.07 seconds to destroy the instance on the hypervisor.
Apr 14 17:34:36 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:34:36 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:34:36 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Took 0.82 seconds to deallocate network for instance.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-deleted-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:37 user nova-compute[71689]: INFO nova.compute.manager [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Neutron deleted interface 8099356e-819f-4d82-8d19-38637909cf0c; detaching it from the instance and deleting it from the info cache
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.network.neutron [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:37 user nova-compute[71689]: WARNING nova.volume.cinder [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Attachment df2af797-4534-428c-ba23-0dc1fde9aa26 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = df2af797-4534-428c-ba23-0dc1fde9aa26. (HTTP 404) (Request-ID: req-327a5197-16c3-4cd7-8200-a207741f0eef)
Apr 14 17:34:37 user nova-compute[71689]: INFO nova.compute.manager [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Took 0.04 seconds to detach 1 volumes for instance.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Detach interface failed, port_id=8099356e-819f-4d82-8d19-38637909cf0c, reason: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. {{(pid=71689) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:37 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Deleted allocations for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:34:37 user nova-compute[71689]: WARNING nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state deleted and task_state None.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:34:37 user nova-compute[71689]: WARNING nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state deleted and task_state None.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:34:37 user nova-compute[71689]: WARNING nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state deleted and task_state None.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-unplugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-unplugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:34:37 user nova-compute[71689]: WARNING nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-unplugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state deleted and task_state None.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Acquiring lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:37 user nova-compute[71689]: DEBUG nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] No waiting events found dispatching network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:34:37 user nova-compute[71689]: WARNING nova.compute.manager [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Received unexpected event network-vif-plugged-8099356e-819f-4d82-8d19-38637909cf0c for instance with vm_state deleted and task_state None.
Apr 14 17:34:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "abe0d33a-5e2f-4b27-b79f-a1e934e7db49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:34:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:34:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:34:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:34:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=26.218250274658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:34:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493676.0081933, abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:34:51 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] VM Stopped (Lifecycle Event)
Apr 14 17:34:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-581963ea-0049-4617-88f6-7547868cbec0 None None] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:34:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:34:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:34:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:34:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:34:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:34:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:34:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:35:10 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:35:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:35:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:35:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:35:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:35:45 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:35:45 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=26.21710968017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:35:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:35:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:35:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:36:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:36:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:36:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:36:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:36:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:27 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:36:27 user nova-compute[71689]: INFO nova.compute.claims [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Claim successful on node user
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:36:28 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:36:28 user nova-compute[71689]: INFO nova.virt.block_device [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Booting with volume 4db052d4-23e3-49f9-b401-4fea76efe595 at /dev/vda
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.policy [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG os_brick.utils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d397411-190f-4da9-8701-fdb22d0d1d1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0af471-c223-4d00-8d93-75a5aa3cd1a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d10cd93-2088-4b16-bbf6-09fe74f6c01e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91e4aa-3c6b-4f95-a82d-549005046e20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:36:28 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:36:28 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c58fc5e-10c0-4b2a-a8ca-a080a1de2c2b]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG os_brick.utils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating existing volume attachment record: 0abb2ffd-c34e-412a-b997-96295cd1d1a7 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:36:28 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Successfully created port: 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Successfully updated port: 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing instance network info cache due to event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:36:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance network_info: |[{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated VIF entry in instance network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:36:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:36:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Creating image(s)
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Ensure instance console log exists: /opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Start _get_guest_xml network_info=[{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd921bfb3-1d65-44fe-ad66-7821d9fa2959', 'attached_at': '', 'detached_at': '', 'volume_id': '4db052d4-23e3-49f9-b401-4fea76efe595', 'serial': '4db052d4-23e3-49f9-b401-4fea76efe595'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0abb2ffd-c34e-412a-b997-96295cd1d1a7', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:36:32 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:36:32 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:36:32 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:36:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:36:32 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:36:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:36:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:36:32 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:36:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39961a3-8f6c-4f69-a1aa-bcb4b64b5b2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:36:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[35303462-edc4-4951-9e4b-c7e2c684e002]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595] added
Apr 14 17:36:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3a4822-6354-4264-8126-2c9b997249b2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffcbef-1e76-449c-97d9-02b471b06e6b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhCnGMZa {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhCnGMZa" returned: 0 in 0.196s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19670b3-a6d5-4af3-b3ca-128d96db05df]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhCnGMZa'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9466b-1bb3-4ded-8ad0-3497f0d9b1f7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[22711680-445f-4331-977d-5aa400f0a5ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:36:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:36:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:36:33 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:36:33 user nova-compute[71689]: 
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1164aa17-d83d-4029-93e5-cb466238f1d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]
Apr 14 17:36:33 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.
Apr 14 17:36:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be25031-5397-48d1-92fd-d194da46cc3b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0608700-6a6e-4df1-be1d-c166b31dc7bc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:36:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:36:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15ac8e-f75b-4b82-a18b-81177b87060a]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:36:33 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23038333434353465', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038333434353465', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1961689222',display_name='tempest-TestShelveInstance-server-1961689222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1961689222',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT1U7XDG7RnEtgS2xjqweyDn7tiGrqQpot4AWIq0XrwxuP3sFX0kklQCONCkEzA0dnykTrQih+YLx4JYuN7eOJ9ov54yHPXPwLmjsJV2QQNMEGpbqbsUsga7ih7IQEhhw==',key_name='tempest-TestShelveInstance-291918457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='684b940d5fdd4a47a9132ae253e07b1c',ramdisk_id='',reservation_id='r-jp3c8bqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1112839499',owner_user_name='tempest-TestShelveInstance-1112839499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:36:28Z,user_data=None,user_id='695d06748c274b01830f3bb9216d3ad8',uuid=d921bfb3-1d65-44fe-ad66-7821d9fa2959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converting VIF {"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.objects.instance [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'pci_devices' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:36:34 user nova-compute[71689]:   <uuid>d921bfb3-1d65-44fe-ad66-7821d9fa2959</uuid>
Apr 14 17:36:34 user nova-compute[71689]:   <name>instance-00000029</name>
Apr 14 17:36:34 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:36:34 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:36:34 user nova-compute[71689]:   <metadata>
Apr 14 17:36:34 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:36:34 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:36:34 user nova-compute[71689]:       <nova:name>tempest-TestShelveInstance-server-1961689222</nova:name>
Apr 14 17:36:34 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:36:32</nova:creationTime>
Apr 14 17:36:34 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:36:34 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:36:34 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:36:34 user nova-compute[71689]:       <nova:owner>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:user uuid="695d06748c274b01830f3bb9216d3ad8">tempest-TestShelveInstance-1112839499-project-member</nova:user>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:project uuid="684b940d5fdd4a47a9132ae253e07b1c">tempest-TestShelveInstance-1112839499</nova:project>
Apr 14 17:36:34 user nova-compute[71689]:       </nova:owner>
Apr 14 17:36:34 user nova-compute[71689]:       <nova:ports>
Apr 14 17:36:34 user nova-compute[71689]:         <nova:port uuid="8d285b5b-c38f-43ea-9399-786253f061d5">
Apr 14 17:36:34 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:36:34 user nova-compute[71689]:         </nova:port>
Apr 14 17:36:34 user nova-compute[71689]:       </nova:ports>
Apr 14 17:36:34 user nova-compute[71689]:     </nova:instance>
Apr 14 17:36:34 user nova-compute[71689]:   </metadata>
Apr 14 17:36:34 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:36:34 user nova-compute[71689]:     <system>
Apr 14 17:36:34 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:36:34 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:36:34 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:36:34 user nova-compute[71689]:       <entry name="serial">d921bfb3-1d65-44fe-ad66-7821d9fa2959</entry>
Apr 14 17:36:34 user nova-compute[71689]:       <entry name="uuid">d921bfb3-1d65-44fe-ad66-7821d9fa2959</entry>
Apr 14 17:36:34 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:36:34 user nova-compute[71689]:     </system>
Apr 14 17:36:34 user nova-compute[71689]:   </sysinfo>
Apr 14 17:36:34 user nova-compute[71689]:   <os>
Apr 14 17:36:34 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:36:34 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:36:34 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:36:34 user nova-compute[71689]:   </os>
Apr 14 17:36:34 user nova-compute[71689]:   <features>
Apr 14 17:36:34 user nova-compute[71689]:     <acpi/>
Apr 14 17:36:34 user nova-compute[71689]:     <apic/>
Apr 14 17:36:34 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:36:34 user nova-compute[71689]:   </features>
Apr 14 17:36:34 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:36:34 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:36:34 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:36:34 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:36:34 user nova-compute[71689]:   </clock>
Apr 14 17:36:34 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:36:34 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:36:34 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:36:34 user nova-compute[71689]:   </cpu>
Apr 14 17:36:34 user nova-compute[71689]:   <devices>
Apr 14 17:36:34 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:36:34 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:36:34 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:36:34 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:36:34 user nova-compute[71689]:       <serial>4db052d4-23e3-49f9-b401-4fea76efe595</serial>
Apr 14 17:36:34 user nova-compute[71689]:     </disk>
Apr 14 17:36:34 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:36:34 user nova-compute[71689]:       <mac address="fa:16:3e:d4:e0:74"/>
Apr 14 17:36:34 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:36:34 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:36:34 user nova-compute[71689]:       <target dev="tap8d285b5b-c3"/>
Apr 14 17:36:34 user nova-compute[71689]:     </interface>
Apr 14 17:36:34 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:36:34 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959/console.log" append="off"/>
Apr 14 17:36:34 user nova-compute[71689]:     </serial>
Apr 14 17:36:34 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:36:34 user nova-compute[71689]:     <video>
Apr 14 17:36:34 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:36:34 user nova-compute[71689]:     </video>
Apr 14 17:36:34 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:36:34 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:36:34 user nova-compute[71689]:     </rng>
Apr 14 17:36:34 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:36:34 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:36:34 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:36:34 user nova-compute[71689]:     </memballoon>
Apr 14 17:36:34 user nova-compute[71689]:   </devices>
Apr 14 17:36:34 user nova-compute[71689]: </domain>
Apr 14 17:36:34 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1961689222',display_name='tempest-TestShelveInstance-server-1961689222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1961689222',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT1U7XDG7RnEtgS2xjqweyDn7tiGrqQpot4AWIq0XrwxuP3sFX0kklQCONCkEzA0dnykTrQih+YLx4JYuN7eOJ9ov54yHPXPwLmjsJV2QQNMEGpbqbsUsga7ih7IQEhhw==',key_name='tempest-TestShelveInstance-291918457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='684b940d5fdd4a47a9132ae253e07b1c',ramdisk_id='',reservation_id='r-jp3c8bqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1112839499',owner_user_name='tempest-TestShelveInstance-1112839499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:36:28Z,user_data=None,user_id='695d06748c274b01830f3bb9216d3ad8',uuid=d921bfb3-1d65-44fe-ad66-7821d9fa2959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converting VIF {"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG os_vif [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d285b5b-c3, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d285b5b-c3, col_values=(('external_ids', {'iface-id': '8d285b5b-c38f-43ea-9399-786253f061d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:e0:74', 'vm-uuid': 'd921bfb3-1d65-44fe-ad66-7821d9fa2959'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:34 user nova-compute[71689]: INFO os_vif [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3')
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:36:34 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] No VIF found with MAC fa:16:3e:d4:e0:74, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:36:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:36:36 user nova-compute[71689]: WARNING nova.compute.manager [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state building and task_state spawning.
Apr 14 17:36:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493798.1593492, d921bfb3-1d65-44fe-ad66-7821d9fa2959 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] VM Resumed (Lifecycle Event)
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance spawned successfully.
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681493798.1605053, d921bfb3-1d65-44fe-ad66-7821d9fa2959 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] VM Started (Lifecycle Event)
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Took 5.36 seconds to spawn the instance on the hypervisor.
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:36:38 user nova-compute[71689]: WARNING nova.compute.manager [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state building and task_state spawning.
Apr 14 17:36:38 user nova-compute[71689]: INFO nova.compute.manager [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Took 10.45 seconds to build instance.
Apr 14 17:36:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.560s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:36:44 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:36:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:36:46 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:36:46 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=26.205997467041016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:36:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:36:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:36:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:36:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:37:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:37:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:37:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:37:44 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:37:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:37:47 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:37:47 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=26.20534896850586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:37:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:37:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:37:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:37:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:37:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:38:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:38:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:38:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG nova.compute.manager [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing instance network info cache due to event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:38:19 user nova-compute[71689]: DEBUG nova.network.neutron [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:38:20 user nova-compute[71689]: INFO nova.compute.manager [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Shelve offloading
Apr 14 17:38:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-unplugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG nova.compute.manager [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-unplugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:38:20 user nova-compute[71689]: WARNING nova.compute.manager [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-unplugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state active and task_state shelving.
Apr 14 17:38:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG nova.network.neutron [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated VIF entry in instance network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG nova.network.neutron [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:38:20 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:21 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance destroyed successfully.
Apr 14 17:38:21 user nova-compute[71689]: DEBUG nova.compute.manager [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG nova.network.neutron [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:38:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:38:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance destroyed successfully.
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.objects.instance [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'resources' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1961689222',display_name='tempest-TestShelveInstance-server-1961689222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1961689222',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT1U7XDG7RnEtgS2xjqweyDn7tiGrqQpot4AWIq0XrwxuP3sFX0kklQCONCkEzA0dnykTrQih+YLx4JYuN7eOJ9ov54yHPXPwLmjsJV2QQNMEGpbqbsUsga7ih7IQEhhw==',key_name='tempest-TestShelveInstance-291918457',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='684b940d5fdd4a47a9132ae253e07b1c',ramdisk_id='',reservation_id='r-jp3c8bqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1112839499',owner_user_name='tempest-TestShelveInstance-1112839499-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:36:38Z,user_data=None,user_id='695d06748c274b01830f3bb9216d3ad8',uuid=d921bfb3-1d65-44fe-ad66-7821d9fa2959,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converting VIF {"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_vif [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d285b5b-c3, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing instance network info cache due to event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.network.neutron [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:38:22 user nova-compute[71689]: INFO os_vif [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3')
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:38:22 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b16dd8-e147-4a92-860b-3871842bc0b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:38:22 user nova-compute[71689]: No targets found.
Apr 14 17:38:22 user nova-compute[71689]: iSNS:
Apr 14 17:38:22 user nova-compute[71689]: No targets found.
Apr 14 17:38:22 user nova-compute[71689]: STATIC:
Apr 14 17:38:22 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595
Apr 14 17:38:22 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:38:22 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:38:22 user nova-compute[71689]: FIRMWARE:
Apr 14 17:38:22 user nova-compute[71689]: No targets found.
Apr 14 17:38:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:38:22 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:38:22 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c64d3-5640-4cce-8d3b-504d42cb0685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[acca28df-8034-47fa-9f3e-4fd8f0ea7224]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:38:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:38:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c3577f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[208f0890-649d-4bfb-9abc-addeb4b8ca18]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d15aa5-32d6-4237-b584-6c585c546922]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[434027a6-078d-4088-9089-b1cb0f0394fc]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f766b1-ced7-45ff-94ba-5741dcc54634]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.compute.manager [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:38:22 user nova-compute[71689]: WARNING nova.compute.manager [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state active and task_state shelving.
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[00caa3f9-a570-4c13-80b0-8d3005876820]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c7ec4-139e-4b89-920d-1885771fb3c3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]
Apr 14 17:38:22 user nova-compute[71689]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.
Apr 14 17:38:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[306aa152-c835-44b8-bf3b-c3cd6700b918]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] <== disconnect_volume: return (296ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:38:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Deleting instance files /opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959_del
Apr 14 17:38:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Deletion of /opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959_del complete
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.network.neutron [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated VIF entry in instance network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG nova.network.neutron [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": null, "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:38:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:38:23 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Deleted allocations for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959
Apr 14 17:38:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:38:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:38:23 user nova-compute[71689]: DEBUG nova.objects.instance [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'numa_topology' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:38:23 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:38:23 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:38:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.088s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:38:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.631s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:38:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:36 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681493901.0735915, d921bfb3-1d65-44fe-ad66-7821d9fa2959 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:38:36 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] VM Stopped (Lifecycle Event)
Apr 14 17:38:36 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c2314379-8878-4730-b917-0d3a3d8c91fe None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:38:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:38:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:38:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:38:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:38:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:38:48 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:38:48 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=26.204486846923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:38:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:38:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:55 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:38:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:38:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:39:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Verify base images {{(pid=71689) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a
Apr 14 17:39:12 user nova-compute[71689]: WARNING nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Unknown base file: /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Removable base files: /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69 /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6 /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195 /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283 /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28 /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/52e23359b4e037a48b74e47bdac18b0801d5ac69
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5580342fa92939d1afbe3b8b16c1f7801cc8c7ed
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9a1f320b0d027924251d7e8f1fb2431ad82a6afc
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5380f362395fb6fa9919162d4c71ffe083b1f0c6
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/611946fa9b690c1e3938031eba0c03c997467195
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a1ec845f84f620eb7028c539715fb4689e12d283
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/53548ab6a50f1e8258800bc75b560b86d05bf2ef
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d10a48d4988a47760f42398df3e83f6888daaf28
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/17bdf6cd9e2d26f675fe29289601017230dbec3a
Apr 14 17:39:12 user nova-compute[71689]: INFO nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/74274782a0a3f9f7156c90a86dd7754ff4c42350
Apr 14 17:39:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Verification complete {{(pid=71689) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Verify swap images {{(pid=71689) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG nova.virt.libvirt.imagecache [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Verify ephemeral images {{(pid=71689) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 17:39:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:39:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:43 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:39:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:39:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:39:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:39:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:39:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:39:50 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=26.203895568847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:39:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:39:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:39:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:39:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:39:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:39:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:39:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:40:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:40:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:40:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:40:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:40:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:11 user nova-compute[71689]: INFO nova.compute.manager [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Unshelving
Apr 14 17:40:11 user nova-compute[71689]: INFO nova.virt.block_device [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Booting with volume 4db052d4-23e3-49f9-b401-4fea76efe595 at /dev/vda
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG os_brick.utils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad5c7e-964e-47ec-8dc6-bac04b2bf5f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73b83d-ebaf-4844-8f59-023f433110e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c5ba2a-eb8e-49a3-a739-16c238291967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba0ffd-bd5a-4399-bc11-8273c3cc4080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:40:12 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:40:12 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[99748a2e-0eb2-45b1-8ff2-37cd5ebf6972]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG os_brick.utils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating existing volume attachment record: 26d7473e-f2da-407b-9097-f16bda875b65 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:40:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'pci_requests' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'numa_topology' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:40:16 user nova-compute[71689]: INFO nova.compute.claims [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Claim successful on node user
Apr 14 17:40:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:40:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:16 user nova-compute[71689]: INFO nova.network.neutron [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating port 8d285b5b-c38f-43ea-9399-786253f061d5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing instance network info cache due to event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:40:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.network.neutron [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:40:18 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Creating image(s)
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Ensure instance console log exists: /opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Start _get_guest_xml network_info=[{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd921bfb3-1d65-44fe-ad66-7821d9fa2959', 'attached_at': '', 'detached_at': '', 'volume_id': '4db052d4-23e3-49f9-b401-4fea76efe595', 'serial': '4db052d4-23e3-49f9-b401-4fea76efe595'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '26d7473e-f2da-407b-9097-f16bda875b65', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:40:18 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:40:18 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'vcpu_model' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:40:18 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:40:18 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:40:18 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea9628-84b0-4c85-a7a0-42a5b4c98ad5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:40:18 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7216a104-38da-436f-9d3b-867cef54bb74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595] added
Apr 14 17:40:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.196s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e16b2fa-b634-4922-bd16-fdf922dbafac]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[73019d42-1c81-4136-8c65-620ece2a6b6f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhCnGMZa {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhCnGMZa" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630b360-5d62-4c53-b62d-98ca8e26ba72]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhCnGMZa'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a344242-73ec-43ae-be33-ccbd3d829ceb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3fa864-16ab-410f-b17f-593f3880b914]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:40:18 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:40:18 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:40:18 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:40:18 user nova-compute[71689]: 
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[03feea1b-400b-4c38-b9e5-60dac26a8234]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]
Apr 14 17:40:18 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.
Apr 14 17:40:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa116c48-0d20-4427-a4a1-13dd58e3def2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[847bc322-8a97-42f5-8450-89338c0047f6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:40:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:40:18 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated VIF entry in instance network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[73695432-5bed-46f6-95d5-0d3c7797dd04]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:40:18 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23038333434353465', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038333434353465', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1961689222',display_name='tempest-TestShelveInstance-server-1961689222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1961689222',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-291918457',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='684b940d5fdd4a47a9132ae253e07b1c',ramdisk_id='',reservation_id='r-jp3c8bqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1112839499',owner_user_name='tempest-TestShelveInstance-1112839499-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:40:12Z,user_data=None,user_id='695d06748c274b01830f3bb9216d3ad8',uuid=d921bfb3-1d65-44fe-ad66-7821d9fa2959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converting VIF {"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.objects.instance [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'pci_devices' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:40:19 user nova-compute[71689]:   <uuid>d921bfb3-1d65-44fe-ad66-7821d9fa2959</uuid>
Apr 14 17:40:19 user nova-compute[71689]:   <name>instance-00000029</name>
Apr 14 17:40:19 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:40:19 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:40:19 user nova-compute[71689]:   <metadata>
Apr 14 17:40:19 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:40:19 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:40:19 user nova-compute[71689]:       <nova:name>tempest-TestShelveInstance-server-1961689222</nova:name>
Apr 14 17:40:19 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:40:18</nova:creationTime>
Apr 14 17:40:19 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:40:19 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:40:19 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:40:19 user nova-compute[71689]:       <nova:owner>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:user uuid="695d06748c274b01830f3bb9216d3ad8">tempest-TestShelveInstance-1112839499-project-member</nova:user>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:project uuid="684b940d5fdd4a47a9132ae253e07b1c">tempest-TestShelveInstance-1112839499</nova:project>
Apr 14 17:40:19 user nova-compute[71689]:       </nova:owner>
Apr 14 17:40:19 user nova-compute[71689]:       <nova:ports>
Apr 14 17:40:19 user nova-compute[71689]:         <nova:port uuid="8d285b5b-c38f-43ea-9399-786253f061d5">
Apr 14 17:40:19 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 17:40:19 user nova-compute[71689]:         </nova:port>
Apr 14 17:40:19 user nova-compute[71689]:       </nova:ports>
Apr 14 17:40:19 user nova-compute[71689]:     </nova:instance>
Apr 14 17:40:19 user nova-compute[71689]:   </metadata>
Apr 14 17:40:19 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:40:19 user nova-compute[71689]:     <system>
Apr 14 17:40:19 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:40:19 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:40:19 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:40:19 user nova-compute[71689]:       <entry name="serial">d921bfb3-1d65-44fe-ad66-7821d9fa2959</entry>
Apr 14 17:40:19 user nova-compute[71689]:       <entry name="uuid">d921bfb3-1d65-44fe-ad66-7821d9fa2959</entry>
Apr 14 17:40:19 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:40:19 user nova-compute[71689]:     </system>
Apr 14 17:40:19 user nova-compute[71689]:   </sysinfo>
Apr 14 17:40:19 user nova-compute[71689]:   <os>
Apr 14 17:40:19 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:40:19 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:40:19 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:40:19 user nova-compute[71689]:   </os>
Apr 14 17:40:19 user nova-compute[71689]:   <features>
Apr 14 17:40:19 user nova-compute[71689]:     <acpi/>
Apr 14 17:40:19 user nova-compute[71689]:     <apic/>
Apr 14 17:40:19 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:40:19 user nova-compute[71689]:   </features>
Apr 14 17:40:19 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:40:19 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:40:19 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:40:19 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:40:19 user nova-compute[71689]:   </clock>
Apr 14 17:40:19 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:40:19 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:40:19 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:40:19 user nova-compute[71689]:   </cpu>
Apr 14 17:40:19 user nova-compute[71689]:   <devices>
Apr 14 17:40:19 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:40:19 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:40:19 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:40:19 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:40:19 user nova-compute[71689]:       <serial>4db052d4-23e3-49f9-b401-4fea76efe595</serial>
Apr 14 17:40:19 user nova-compute[71689]:     </disk>
Apr 14 17:40:19 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:40:19 user nova-compute[71689]:       <mac address="fa:16:3e:d4:e0:74"/>
Apr 14 17:40:19 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:40:19 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:40:19 user nova-compute[71689]:       <target dev="tap8d285b5b-c3"/>
Apr 14 17:40:19 user nova-compute[71689]:     </interface>
Apr 14 17:40:19 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:40:19 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959/console.log" append="off"/>
Apr 14 17:40:19 user nova-compute[71689]:     </serial>
Apr 14 17:40:19 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:40:19 user nova-compute[71689]:     <video>
Apr 14 17:40:19 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:40:19 user nova-compute[71689]:     </video>
Apr 14 17:40:19 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:40:19 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:40:19 user nova-compute[71689]:     </rng>
Apr 14 17:40:19 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:40:19 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:40:19 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:40:19 user nova-compute[71689]:     </memballoon>
Apr 14 17:40:19 user nova-compute[71689]:   </devices>
Apr 14 17:40:19 user nova-compute[71689]: </domain>
Apr 14 17:40:19 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1961689222',display_name='tempest-TestShelveInstance-server-1961689222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1961689222',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-291918457',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='684b940d5fdd4a47a9132ae253e07b1c',ramdisk_id='',reservation_id='r-jp3c8bqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1112839499',owner_user_name='tempest-TestShelveInstance-1112839499-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:40:12Z,user_data=None,user_id='695d06748c274b01830f3bb9216d3ad8',uuid=d921bfb3-1d65-44fe-ad66-7821d9fa2959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converting VIF {"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG os_vif [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d285b5b-c3, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d285b5b-c3, col_values=(('external_ids', {'iface-id': '8d285b5b-c38f-43ea-9399-786253f061d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:e0:74', 'vm-uuid': 'd921bfb3-1d65-44fe-ad66-7821d9fa2959'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:19 user nova-compute[71689]: INFO os_vif [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3')
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:40:19 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] No VIF found with MAC fa:16:3e:d4:e0:74, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:40:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG nova.compute.manager [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:40:21 user nova-compute[71689]: WARNING nova.compute.manager [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 17:40:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494023.0354755, d921bfb3-1d65-44fe-ad66-7821d9fa2959 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:40:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] VM Resumed (Lifecycle Event)
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:40:23 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance spawned successfully.
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:40:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494023.0368092, d921bfb3-1d65-44fe-ad66-7821d9fa2959 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:40:23 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] VM Started (Lifecycle Event)
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.262s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:40:23 user nova-compute[71689]: WARNING nova.compute.manager [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state active and task_state None.
Apr 14 17:40:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:40:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:45 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:40:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:50 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:40:51 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:40:51 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=26.202342987060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:40:51 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:40:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:40:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:40:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:07 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Triggering sync for uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 17:41:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:41:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:41:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:41:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:41:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:41:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:41:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:41:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:41:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:41:52 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:41:52 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=26.201766967773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:41:52 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:41:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:41:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:41:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing instance network info cache due to event network-changed-8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Acquiring lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Acquired lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Refreshing network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:02 user nova-compute[71689]: INFO nova.compute.manager [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Terminating instance
Apr 14 17:42:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updated VIF entry in instance network info cache for port 8d285b5b-c38f-43ea-9399-786253f061d5. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:42:02 user nova-compute[71689]: DEBUG nova.network.neutron [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [{"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Releasing lock "refresh_cache-d921bfb3-1d65-44fe-ad66-7821d9fa2959" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:42:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Instance destroyed successfully.
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'resources' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T17:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1961689222',display_name='tempest-TestShelveInstance-server-1961689222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1961689222',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT1U7XDG7RnEtgS2xjqweyDn7tiGrqQpot4AWIq0XrwxuP3sFX0kklQCONCkEzA0dnykTrQih+YLx4JYuN7eOJ9ov54yHPXPwLmjsJV2QQNMEGpbqbsUsga7ih7IQEhhw==',key_name='tempest-TestShelveInstance-291918457',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='684b940d5fdd4a47a9132ae253e07b1c',ramdisk_id='',reservation_id='r-jp3c8bqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1112839499',owner_user_name='tempest-TestShelveInstance-1112839499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:40:23Z,user_data=None,user_id='695d06748c274b01830f3bb9216d3ad8',uuid=d921bfb3-1d65-44fe-ad66-7821d9fa2959,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converting VIF {"id": "8d285b5b-c38f-43ea-9399-786253f061d5", "address": "fa:16:3e:d4:e0:74", "network": {"id": "df6d9060-35ac-422b-9484-43dceb1606ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-525538354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "684b940d5fdd4a47a9132ae253e07b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d285b5b-c3", "ovs_interfaceid": "8d285b5b-c38f-43ea-9399-786253f061d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_vif [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d285b5b-c3, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:03 user nova-compute[71689]: INFO os_vif [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=8d285b5b-c38f-43ea-9399-786253f061d5,network=Network(df6d9060-35ac-422b-9484-43dceb1606ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d285b5b-c3')
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhCnGMZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:42:03 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a347eae5-df48-496c-b21d-5923a9a5d14d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:42:03 user nova-compute[71689]: No targets found.
Apr 14 17:42:03 user nova-compute[71689]: iSNS:
Apr 14 17:42:03 user nova-compute[71689]: No targets found.
Apr 14 17:42:03 user nova-compute[71689]: STATIC:
Apr 14 17:42:03 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595
Apr 14 17:42:03 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:42:03 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:42:03 user nova-compute[71689]: FIRMWARE:
Apr 14 17:42:03 user nova-compute[71689]: No targets found.
Apr 14 17:42:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:42:03 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:42:03 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af28f1c-489f-4d08-b04b-b5a5e5d761cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe159f9f-4a9b-4739-8f92-0053c515ef92]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:42:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 (non-flash)
Apr 14 17:42:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b594d0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[683c693b-284b-4e8f-baad-6eba0a570bda]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df5f48-30ed-4af3-a2a4-5e2abf4684d8]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[459cd9e0-7563-4504-93f5-1f8860763ca9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cce9712-18b0-40c5-a1c9-3a5b542394ae]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23038333434353465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ac0890bd', '/dev/disk/by-id/scsi-1SCST_BIOac0890bd-0834454ef2327606') {{(pid=81988) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0be077-0a3e-4722-baaa-492d37c37a1c]: (4, None) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cf38bb-ff8e-41f5-b1ef-879297bc69ca]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4439c5aa-c375-4851-95cb-d4821c1c87df]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260]
Apr 14 17:42:03 user nova-compute[71689]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595, portal: 172.16.0.220,3260] successful.
Apr 14 17:42:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db052d4-23e3-49f9-b401-4fea76efe595 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ec3233-633f-4e7f-8996-340a9e8cfba9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] <== disconnect_volume: return (287ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:42:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Deleting instance files /opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959_del
Apr 14 17:42:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Deletion of /opt/stack/data/nova/instances/d921bfb3-1d65-44fe-ad66-7821d9fa2959_del complete
Apr 14 17:42:03 user nova-compute[71689]: INFO nova.compute.manager [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 14 17:42:03 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:42:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:42:04 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Took 0.56 seconds to deallocate network for instance.
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-deleted-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-unplugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-unplugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-unplugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Acquiring lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] No waiting events found dispatching network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:42:04 user nova-compute[71689]: WARNING nova.compute.manager [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Received unexpected event network-vif-plugged-8d285b5b-c38f-43ea-9399-786253f061d5 for instance with vm_state active and task_state deleting.
Apr 14 17:42:04 user nova-compute[71689]: INFO nova.compute.manager [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Took 0.76 seconds to detach 1 volumes for instance.
Apr 14 17:42:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Deleting volume: 4db052d4-23e3-49f9-b401-4fea76efe595 {{(pid=71689) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 17:42:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:05 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:42:05 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:42:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:05 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Deleted allocations for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959
Apr 14 17:42:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "d921bfb3-1d65-44fe-ad66-7821d9fa2959" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:18 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681494123.2377274, d921bfb3-1d65-44fe-ad66-7821d9fa2959 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:42:18 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] VM Stopped (Lifecycle Event)
Apr 14 17:42:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-71e0a954-7be5-4a64-a1d8-58703818096b None None] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:42:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:42:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:42:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:42:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:42:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:42:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:42:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:42:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:42:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:42:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:42:43 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:42:48 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:42:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:42:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:53 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:42:53 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=26.20092010498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:42:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:42:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:42:58 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:08 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:18 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:43:23 user nova-compute[71689]: INFO nova.compute.claims [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Claim successful on node user
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:43:23 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:43:23 user nova-compute[71689]: INFO nova.virt.block_device [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Booting with volume snapshot e0cad371-83ab-4806-a1ac-78afe5d4d55c at /dev/vda
Apr 14 17:43:23 user nova-compute[71689]: DEBUG nova.policy [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:43:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Successfully created port: b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Successfully updated port: b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquired lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-changed-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG nova.compute.manager [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Refreshing instance network info cache due to event network-changed-b4a68cbf-b401-4542-abe2-0fdbe2744a59. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Acquiring lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:43:24 user nova-compute[71689]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updating instance_info_cache with network_info: [{"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Releasing lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Instance network_info: |[{"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Acquired lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG nova.network.neutron [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Refreshing network info cache for port b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG nova.network.neutron [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updated VIF entry in instance network info cache for port b4a68cbf-b401-4542-abe2-0fdbe2744a59. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG nova.network.neutron [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updating instance_info_cache with network_info: [{"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:43:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Releasing lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:43:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG os_brick.utils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf74f3e-1c5b-4598-98d1-c77c27730a62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337c0af-5607-469a-8483-db3fdebd488a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c19b36-158c-4d8c-8a04-7137f0c8700f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[174053d4-8e48-4397-8181-f4013b254b3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:43:29 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:43:29 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[831d0001-77fb-4035-9760-dcffd4982eac]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG os_brick.utils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:43:29 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updating existing volume attachment record: 20b5379c-ba89-4632-bd7a-9b8635b8518e {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:43:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:43:33 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Creating image(s)
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Ensure instance console log exists: /opt/stack/data/nova/instances/0bdd229d-9e6b-434a-9f05-5b715965d406/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Start _get_guest_xml network_info=[{"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWdPSuZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0bdd229d-9e6b-434a-9f05-5b715965d406', 'attached_at': '', 'detached_at': '', 'volume_id': '226e370f-3d7c-49a6-a7e4-dcb13abf5bef', 'serial': '226e370f-3d7c-49a6-a7e4-dcb13abf5bef'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '20b5379c-ba89-4632-bd7a-9b8635b8518e', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:43:33 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:43:33 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWdPSuZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:43:33 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:43:33 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:43:33 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797559b-47fa-445e-af89-c243bf6c3944]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:43:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9991e4c-ae47-4afb-9c9a-4e6f2cfc9907]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef] added
Apr 14 17:43:33 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4342045-7655-4835-877f-5f359a0c0e45]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b2e18-fddf-45a0-86f0-7c0b22b6bfdb]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWdPSuZJ {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWdPSuZJ" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec6d240-0b98-4f4b-9891-7abe92c8730b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWdPSuZJ'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf49e8-af90-4d95-b6e0-20a32580dad2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7030e3d-f676-4568-8ec2-fef5b5444459]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:43:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:43:33 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:43:33 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:43:33 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:43:33 user nova-compute[71689]: 
Apr 14 17:43:33 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f978868-2c5d-43b4-9ee3-14ee5133c5a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260]
Apr 14 17:43:34 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260] successful.
Apr 14 17:43:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ad697-03e8-4ecf-bf42-51f9c3f57d31]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8067a19d-50b3-48cf-9bc3-2f7006359048]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef (non-flash)
Apr 14 17:43:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef (non-flash)
Apr 14 17:43:34 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[921547a7-9924-499e-8096-defc04824e38]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:43:34 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWdPSuZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23132313737663630', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132313737663630', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1351290960',display_name='tempest-TestVolumeBootPattern-server-1351290960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1351290960',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-6zoiehag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:43:23Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=0bdd229d-9e6b-434a-9f05-5b715965d406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.objects.instance [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bdd229d-9e6b-434a-9f05-5b715965d406 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:43:35 user nova-compute[71689]:   <uuid>0bdd229d-9e6b-434a-9f05-5b715965d406</uuid>
Apr 14 17:43:35 user nova-compute[71689]:   <name>instance-0000002a</name>
Apr 14 17:43:35 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:43:35 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:43:35 user nova-compute[71689]:   <metadata>
Apr 14 17:43:35 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:43:35 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:43:35 user nova-compute[71689]:       <nova:name>tempest-TestVolumeBootPattern-server-1351290960</nova:name>
Apr 14 17:43:35 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:43:33</nova:creationTime>
Apr 14 17:43:35 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:43:35 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:43:35 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:43:35 user nova-compute[71689]:       <nova:owner>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:user uuid="f86537c1b58843d399db6cec00012c50">tempest-TestVolumeBootPattern-725648218-project-member</nova:user>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:project uuid="47e868622506423e80b158e7bf60c561">tempest-TestVolumeBootPattern-725648218</nova:project>
Apr 14 17:43:35 user nova-compute[71689]:       </nova:owner>
Apr 14 17:43:35 user nova-compute[71689]:       <nova:ports>
Apr 14 17:43:35 user nova-compute[71689]:         <nova:port uuid="b4a68cbf-b401-4542-abe2-0fdbe2744a59">
Apr 14 17:43:35 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:43:35 user nova-compute[71689]:         </nova:port>
Apr 14 17:43:35 user nova-compute[71689]:       </nova:ports>
Apr 14 17:43:35 user nova-compute[71689]:     </nova:instance>
Apr 14 17:43:35 user nova-compute[71689]:   </metadata>
Apr 14 17:43:35 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:43:35 user nova-compute[71689]:     <system>
Apr 14 17:43:35 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:43:35 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:43:35 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:43:35 user nova-compute[71689]:       <entry name="serial">0bdd229d-9e6b-434a-9f05-5b715965d406</entry>
Apr 14 17:43:35 user nova-compute[71689]:       <entry name="uuid">0bdd229d-9e6b-434a-9f05-5b715965d406</entry>
Apr 14 17:43:35 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:43:35 user nova-compute[71689]:     </system>
Apr 14 17:43:35 user nova-compute[71689]:   </sysinfo>
Apr 14 17:43:35 user nova-compute[71689]:   <os>
Apr 14 17:43:35 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:43:35 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:43:35 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:43:35 user nova-compute[71689]:   </os>
Apr 14 17:43:35 user nova-compute[71689]:   <features>
Apr 14 17:43:35 user nova-compute[71689]:     <acpi/>
Apr 14 17:43:35 user nova-compute[71689]:     <apic/>
Apr 14 17:43:35 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:43:35 user nova-compute[71689]:   </features>
Apr 14 17:43:35 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:43:35 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:43:35 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:43:35 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:43:35 user nova-compute[71689]:   </clock>
Apr 14 17:43:35 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:43:35 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:43:35 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:43:35 user nova-compute[71689]:   </cpu>
Apr 14 17:43:35 user nova-compute[71689]:   <devices>
Apr 14 17:43:35 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:43:35 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:43:35 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:43:35 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:43:35 user nova-compute[71689]:       <serial>226e370f-3d7c-49a6-a7e4-dcb13abf5bef</serial>
Apr 14 17:43:35 user nova-compute[71689]:     </disk>
Apr 14 17:43:35 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:43:35 user nova-compute[71689]:       <mac address="fa:16:3e:9a:08:37"/>
Apr 14 17:43:35 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:43:35 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:43:35 user nova-compute[71689]:       <target dev="tapb4a68cbf-b4"/>
Apr 14 17:43:35 user nova-compute[71689]:     </interface>
Apr 14 17:43:35 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:43:35 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/0bdd229d-9e6b-434a-9f05-5b715965d406/console.log" append="off"/>
Apr 14 17:43:35 user nova-compute[71689]:     </serial>
Apr 14 17:43:35 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:43:35 user nova-compute[71689]:     <video>
Apr 14 17:43:35 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:43:35 user nova-compute[71689]:     </video>
Apr 14 17:43:35 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:43:35 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:43:35 user nova-compute[71689]:     </rng>
Apr 14 17:43:35 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:43:35 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:43:35 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:43:35 user nova-compute[71689]:     </memballoon>
Apr 14 17:43:35 user nova-compute[71689]:   </devices>
Apr 14 17:43:35 user nova-compute[71689]: </domain>
Apr 14 17:43:35 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1351290960',display_name='tempest-TestVolumeBootPattern-server-1351290960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1351290960',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-6zoiehag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:43:23Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=0bdd229d-9e6b-434a-9f05-5b715965d406,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG os_vif [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4a68cbf-b4, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4a68cbf-b4, col_values=(('external_ids', {'iface-id': 'b4a68cbf-b401-4542-abe2-0fdbe2744a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:08:37', 'vm-uuid': '0bdd229d-9e6b-434a-9f05-5b715965d406'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:35 user nova-compute[71689]: INFO os_vif [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4')
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:43:35 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No VIF found with MAC fa:16:3e:9a:08:37, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:36 user nova-compute[71689]: DEBUG nova.compute.manager [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] No waiting events found dispatching network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:43:36 user nova-compute[71689]: WARNING nova.compute.manager [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received unexpected event network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance with vm_state building and task_state spawning.
Apr 14 17:43:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494218.9183116, 0bdd229d-9e6b-434a-9f05-5b715965d406 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:43:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] VM Resumed (Lifecycle Event)
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:43:38 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Instance spawned successfully.
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:43:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494218.9196932, 0bdd229d-9e6b-434a-9f05-5b715965d406 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:43:38 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] VM Started (Lifecycle Event)
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] No waiting events found dispatching network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:43:38 user nova-compute[71689]: WARNING nova.compute.manager [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received unexpected event network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance with vm_state building and task_state spawning.
Apr 14 17:43:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:43:39 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:43:39 user nova-compute[71689]: INFO nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 14 17:43:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:43:39 user nova-compute[71689]: INFO nova.compute.manager [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Took 16.07 seconds to build instance.
Apr 14 17:43:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.163s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:47 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:43:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:43:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 0bdd229d-9e6b-434a-9f05-5b715965d406 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updating instance_info_cache with network_info: [{"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:43:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:43:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=26.18975067138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:43:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:43:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:43:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:05 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:44:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:26 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:44:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:44:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:44:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:44:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:48 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:44:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 0bdd229d-9e6b-434a-9f05-5b715965d406 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updating instance_info_cache with network_info: [{"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-0bdd229d-9e6b-434a-9f05-5b715965d406" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:44:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:44:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:44:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=26.18914794921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:44:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:44:55 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:44:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:44:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:13 user nova-compute[71689]: INFO nova.compute.manager [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Terminating instance
Apr 14 17:45:13 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:13 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-vif-unplugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] No waiting events found dispatching network-vif-unplugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.compute.manager [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-vif-unplugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:14 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Instance destroyed successfully.
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.objects.instance [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'resources' on Instance uuid 0bdd229d-9e6b-434a-9f05-5b715965d406 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1351290960',display_name='tempest-TestVolumeBootPattern-server-1351290960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1351290960',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-6zoiehag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:43:39Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=0bdd229d-9e6b-434a-9f05-5b715965d406,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "address": "fa:16:3e:9a:08:37", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a68cbf-b4", "ovs_interfaceid": "b4a68cbf-b401-4542-abe2-0fdbe2744a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_vif [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4a68cbf-b4, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:45:14 user nova-compute[71689]: INFO os_vif [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:08:37,bridge_name='br-int',has_traffic_filtering=True,id=b4a68cbf-b401-4542-abe2-0fdbe2744a59,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a68cbf-b4')
Apr 14 17:45:14 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWdPSuZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:45:14 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e95dee-5230-437c-9f9e-d3db9f128346]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:45:14 user nova-compute[71689]: No targets found.
Apr 14 17:45:14 user nova-compute[71689]: iSNS:
Apr 14 17:45:14 user nova-compute[71689]: No targets found.
Apr 14 17:45:14 user nova-compute[71689]: STATIC:
Apr 14 17:45:14 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef
Apr 14 17:45:14 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:45:14 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:45:14 user nova-compute[71689]: FIRMWARE:
Apr 14 17:45:14 user nova-compute[71689]: No targets found.
Apr 14 17:45:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:45:14 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:45:14 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa58910-ec23-4fc9-8a85-21d886389b1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0aafd-b714-49b7-a1c3-e7baf20ccc7d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef (non-flash)
Apr 14 17:45:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef (non-flash)
Apr 14 17:45:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c357130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc7bbdc-2f3d-4135-8f3a-945df584f0ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2c5f91-1021-4269-a2fd-9b91243fa154]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1111f2cf-a0a3-47e5-b577-aec17a4f8323]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7251b2e-e507-4cb5-959c-a8e472e024ef]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23194d6-bd74-4fb5-86ad-669544653072]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[49439c50-5a0a-440b-a228-fccefedd92c0]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260]
Apr 14 17:45:14 user nova-compute[71689]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef, portal: 172.16.0.220,3260] successful.
Apr 14 17:45:14 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:45:14 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226e370f-3d7c-49a6-a7e4-dcb13abf5bef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df3810b-71f5-48e6-a4fb-985c44a5ae6d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== disconnect_volume: return (327ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:45:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Deleting instance files /opt/stack/data/nova/instances/0bdd229d-9e6b-434a-9f05-5b715965d406_del
Apr 14 17:45:15 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Deletion of /opt/stack/data/nova/instances/0bdd229d-9e6b-434a-9f05-5b715965d406_del complete
Apr 14 17:45:15 user nova-compute[71689]: INFO nova.compute.manager [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 17:45:15 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:45:15 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:45:15 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Took 0.61 seconds to deallocate network for instance.
Apr 14 17:45:15 user nova-compute[71689]: DEBUG nova.compute.manager [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-vif-deleted-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received event network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Acquiring lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] No waiting events found dispatching network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:45:16 user nova-compute[71689]: WARNING nova.compute.manager [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Received unexpected event network-vif-plugged-b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance with vm_state active and task_state deleting.
Apr 14 17:45:16 user nova-compute[71689]: INFO nova.compute.manager [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Took 1.02 seconds to detach 1 volumes for instance.
Apr 14 17:45:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Deleting volume: 226e370f-3d7c-49a6-a7e4-dcb13abf5bef {{(pid=71689) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:45:16 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:16 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Deleted allocations for instance 0bdd229d-9e6b-434a-9f05-5b715965d406
Apr 14 17:45:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "0bdd229d-9e6b-434a-9f05-5b715965d406" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:18 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:45:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:45:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:45:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681494314.6164296, 0bdd229d-9e6b-434a-9f05-5b715965d406 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:45:29 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] VM Stopped (Lifecycle Event)
Apr 14 17:45:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-52b233ef-3bf4-4f75-9788-51ef8322cc71 None None] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:45:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:45:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:45:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:50 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:50 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:45:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:45:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:45:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8895MB free_disk=26.188331604003906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:45:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:45:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:45:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:06 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:46:15 user nova-compute[71689]: INFO nova.compute.claims [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Claim successful on node user
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:46:15 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:46:16 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:46:16 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:46:16 user nova-compute[71689]: INFO nova.virt.block_device [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Booting with volume e040b16e-d08b-4341-a869-cc4ee4629f1c at /dev/vda
Apr 14 17:46:16 user nova-compute[71689]: DEBUG nova.policy [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG os_brick.utils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76b789-b289-43f6-8fec-1b96e8d3c892]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[743d4df4-af6e-401f-a2ea-f1fcd358b38e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d146c9-0558-4fb0-bfdd-64c66ab7d1eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee0b5e-6a4b-468e-8bd4-191a3744799c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:46:16 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:46:16 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefc429-d7f5-4a3d-bacb-71e5c92500a5]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG os_brick.utils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating existing volume attachment record: 05f3af31-90ba-4060-b226-b57bdd47ed58 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:16 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Successfully created port: 7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Successfully updated port: 7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquired lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-changed-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.compute.manager [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Refreshing instance network info cache due to event network-changed-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Acquiring lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating instance_info_cache with network_info: [{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Releasing lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Instance network_info: |[{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Acquired lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:46:17 user nova-compute[71689]: DEBUG nova.network.neutron [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Refreshing network info cache for port 7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:46:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updated VIF entry in instance network info cache for port 7a8c2b1a-57dd-4e05-b244-3a5b880d5adf. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:46:18 user nova-compute[71689]: DEBUG nova.network.neutron [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating instance_info_cache with network_info: [{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:46:18 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Releasing lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:46:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:20 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:46:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:46:20 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Creating image(s)
Apr 14 17:46:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:46:20 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Ensure instance console log exists: /opt/stack/data/nova/instances/bcaa9cda-dd0b-4fa2-9820-8941995f22ed/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Start _get_guest_xml network_info=[{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKUoahzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bcaa9cda-dd0b-4fa2-9820-8941995f22ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'e040b16e-d08b-4341-a869-cc4ee4629f1c', 'serial': 'e040b16e-d08b-4341-a869-cc4ee4629f1c'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '05f3af31-90ba-4060-b226-b57bdd47ed58', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:46:21 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:46:21 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKUoahzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:46:21 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:46:21 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:46:21 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd05c93-0d05-4c26-9b88-16ff999709ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:46:21 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e7dc01-45f2-4b4d-8a32-e892cabbc161]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c] added
Apr 14 17:46:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bce058-4937-4557-a45b-66c8c385c0e4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[833faa45-3b9d-4ceb-bf10-624785430898]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKUoahzB {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKUoahzB" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90615e1-f024-42dc-bbef-61010bf7b0a8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKUoahzB'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6486c4c2-c482-4fa5-8bc2-aa828248976f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4480a0-530f-4bbd-8a61-f5564d1540b4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:46:21 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:46:21 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:46:21 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:46:21 user nova-compute[71689]: 
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddefe20-a1e1-45a4-95ea-0de71f81f087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260]
Apr 14 17:46:21 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260] successful.
Apr 14 17:46:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5098a9-2941-4e46-94e5-cfd6475a1be1]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854769b-61ac-4799-814d-8b146342df83]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:46:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:46:21 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10fbdd8-a9cd-46c9-877c-3f3327d992a0]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:46:21 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKUoahzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23562653937646332', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562653937646332', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1425264582',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1425264582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1425264582',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-3keyai3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:46:16Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=bcaa9cda-dd0b-4fa2-9820-8941995f22ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.objects.instance [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'pci_devices' on Instance uuid bcaa9cda-dd0b-4fa2-9820-8941995f22ed {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:46:22 user nova-compute[71689]:   <uuid>bcaa9cda-dd0b-4fa2-9820-8941995f22ed</uuid>
Apr 14 17:46:22 user nova-compute[71689]:   <name>instance-0000002b</name>
Apr 14 17:46:22 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:46:22 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:46:22 user nova-compute[71689]:   <metadata>
Apr 14 17:46:22 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:46:22 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:46:22 user nova-compute[71689]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1425264582</nova:name>
Apr 14 17:46:22 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:46:21</nova:creationTime>
Apr 14 17:46:22 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:46:22 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:46:22 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:46:22 user nova-compute[71689]:       <nova:owner>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:user uuid="f86537c1b58843d399db6cec00012c50">tempest-TestVolumeBootPattern-725648218-project-member</nova:user>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:project uuid="47e868622506423e80b158e7bf60c561">tempest-TestVolumeBootPattern-725648218</nova:project>
Apr 14 17:46:22 user nova-compute[71689]:       </nova:owner>
Apr 14 17:46:22 user nova-compute[71689]:       <nova:ports>
Apr 14 17:46:22 user nova-compute[71689]:         <nova:port uuid="7a8c2b1a-57dd-4e05-b244-3a5b880d5adf">
Apr 14 17:46:22 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 17:46:22 user nova-compute[71689]:         </nova:port>
Apr 14 17:46:22 user nova-compute[71689]:       </nova:ports>
Apr 14 17:46:22 user nova-compute[71689]:     </nova:instance>
Apr 14 17:46:22 user nova-compute[71689]:   </metadata>
Apr 14 17:46:22 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:46:22 user nova-compute[71689]:     <system>
Apr 14 17:46:22 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:46:22 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:46:22 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:46:22 user nova-compute[71689]:       <entry name="serial">bcaa9cda-dd0b-4fa2-9820-8941995f22ed</entry>
Apr 14 17:46:22 user nova-compute[71689]:       <entry name="uuid">bcaa9cda-dd0b-4fa2-9820-8941995f22ed</entry>
Apr 14 17:46:22 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:46:22 user nova-compute[71689]:     </system>
Apr 14 17:46:22 user nova-compute[71689]:   </sysinfo>
Apr 14 17:46:22 user nova-compute[71689]:   <os>
Apr 14 17:46:22 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:46:22 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:46:22 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:46:22 user nova-compute[71689]:   </os>
Apr 14 17:46:22 user nova-compute[71689]:   <features>
Apr 14 17:46:22 user nova-compute[71689]:     <acpi/>
Apr 14 17:46:22 user nova-compute[71689]:     <apic/>
Apr 14 17:46:22 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:46:22 user nova-compute[71689]:   </features>
Apr 14 17:46:22 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:46:22 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:46:22 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:46:22 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:46:22 user nova-compute[71689]:   </clock>
Apr 14 17:46:22 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:46:22 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:46:22 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:46:22 user nova-compute[71689]:   </cpu>
Apr 14 17:46:22 user nova-compute[71689]:   <devices>
Apr 14 17:46:22 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:46:22 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:46:22 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:46:22 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:46:22 user nova-compute[71689]:       <serial>e040b16e-d08b-4341-a869-cc4ee4629f1c</serial>
Apr 14 17:46:22 user nova-compute[71689]:     </disk>
Apr 14 17:46:22 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:46:22 user nova-compute[71689]:       <mac address="fa:16:3e:b6:0b:aa"/>
Apr 14 17:46:22 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:46:22 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:46:22 user nova-compute[71689]:       <target dev="tap7a8c2b1a-57"/>
Apr 14 17:46:22 user nova-compute[71689]:     </interface>
Apr 14 17:46:22 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:46:22 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/bcaa9cda-dd0b-4fa2-9820-8941995f22ed/console.log" append="off"/>
Apr 14 17:46:22 user nova-compute[71689]:     </serial>
Apr 14 17:46:22 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:46:22 user nova-compute[71689]:     <video>
Apr 14 17:46:22 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:46:22 user nova-compute[71689]:     </video>
Apr 14 17:46:22 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:46:22 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:46:22 user nova-compute[71689]:     </rng>
Apr 14 17:46:22 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:46:22 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:46:22 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:46:22 user nova-compute[71689]:     </memballoon>
Apr 14 17:46:22 user nova-compute[71689]:   </devices>
Apr 14 17:46:22 user nova-compute[71689]: </domain>
Apr 14 17:46:22 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1425264582',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1425264582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1425264582',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-3keyai3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:46:16Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=bcaa9cda-dd0b-4fa2-9820-8941995f22ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG os_vif [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a8c2b1a-57, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a8c2b1a-57, col_values=(('external_ids', {'iface-id': '7a8c2b1a-57dd-4e05-b244-3a5b880d5adf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:0b:aa', 'vm-uuid': 'bcaa9cda-dd0b-4fa2-9820-8941995f22ed'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:22 user nova-compute[71689]: INFO os_vif [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57')
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:46:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No VIF found with MAC fa:16:3e:b6:0b:aa, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:23 user nova-compute[71689]: DEBUG nova.compute.manager [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:46:23 user nova-compute[71689]: WARNING nova.compute.manager [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received unexpected event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with vm_state building and task_state spawning.
Apr 14 17:46:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494385.7634847, bcaa9cda-dd0b-4fa2-9820-8941995f22ed => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] VM Resumed (Lifecycle Event)
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Instance spawned successfully.
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494385.7652702, bcaa9cda-dd0b-4fa2-9820-8941995f22ed => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] VM Started (Lifecycle Event)
Apr 14 17:46:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Took 4.89 seconds to spawn the instance on the hypervisor.
Apr 14 17:46:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:46:25 user nova-compute[71689]: INFO nova.compute.manager [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Took 10.26 seconds to build instance.
Apr 14 17:46:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:46:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:26 user nova-compute[71689]: DEBUG nova.compute.manager [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:46:26 user nova-compute[71689]: WARNING nova.compute.manager [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received unexpected event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with vm_state active and task_state None.
Apr 14 17:46:26 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.400s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:28 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:46:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:46:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:46:54 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=26.186264038085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:46:54 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:46:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:46:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid bcaa9cda-dd0b-4fa2-9820-8941995f22ed {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:46:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating instance_info_cache with network_info: [{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:46:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:46:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:46:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:46:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:46:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:08 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:47:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:47:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:47:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:47:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid bcaa9cda-dd0b-4fa2-9820-8941995f22ed {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating instance_info_cache with network_info: [{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:47:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:47:57 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:47:57 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=26.18564224243164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:47:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:47:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:08 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "413746e7-f044-4604-9ed8-be8af08de775" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:48:11 user nova-compute[71689]: INFO nova.compute.claims [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Claim successful on node user
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:48:11 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:48:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:48:11 user nova-compute[71689]: INFO nova.virt.block_device [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Booting with volume snapshot bab3abf8-5ff2-442b-b50f-525a3ce4d34d at /dev/vda
Apr 14 17:48:12 user nova-compute[71689]: DEBUG nova.policy [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:12 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Successfully created port: fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Successfully updated port: fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquired lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-changed-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG nova.compute.manager [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Refreshing instance network info cache due to event network-changed-fe473fa7-c36d-4db1-a628-aeceb4d6e82e. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:48:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Acquiring lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updating instance_info_cache with network_info: [{"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Releasing lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Instance network_info: |[{"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Acquired lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG nova.network.neutron [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Refreshing network info cache for port fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG nova.network.neutron [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updated VIF entry in instance network info cache for port fe473fa7-c36d-4db1-a628-aeceb4d6e82e. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG nova.network.neutron [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updating instance_info_cache with network_info: [{"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:48:14 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Releasing lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG os_brick.utils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b044ef-107d-4fbe-b082-3a702d6f0015]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea883a4-8e01-4443-b071-401a73f2e58c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e86ee7-65e5-4937-a463-425ae53c9081]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd37dbb-6b1e-4cc6-8d27-014a23832382]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:48:17 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:48:17 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cce793-a7e9-4702-be0d-9afdd62357e8]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG os_brick.utils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:48:17 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updating existing volume attachment record: b8153cba-0111-4ee0-9389-d37147936bed {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:48:22 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Creating image(s)
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Ensure instance console log exists: /opt/stack/data/nova/instances/413746e7-f044-4604-9ed8-be8af08de775/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Start _get_guest_xml network_info=[{"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T17:48:08Z,direct_url=<?>,disk_format='qcow2',id=004b3625-95b1-4d74-8dc1-6e6c69ffff94,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1824097949',owner='47e868622506423e80b158e7bf60c561',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T17:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhXrNwGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '413746e7-f044-4604-9ed8-be8af08de775', 'attached_at': '', 'detached_at': '', 'volume_id': '40324539-e194-41cf-8db5-9074b72172d2', 'serial': '40324539-e194-41cf-8db5-9074b72172d2'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b8153cba-0111-4ee0-9389-d37147936bed', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:48:22 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:48:22 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T17:48:08Z,direct_url=<?>,disk_format='qcow2',id=004b3625-95b1-4d74-8dc1-6e6c69ffff94,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1824097949',owner='47e868622506423e80b158e7bf60c561',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T17:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhXrNwGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:48:22 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:48:22 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:48:22 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d9b824-f728-46db-a095-54139e7a9913]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:48:22 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f26e37-a42e-4598-972a-c36d1e3aeb66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2] added
Apr 14 17:48:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baf0c22-62f3-4a1b-becf-0d0200128066]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[73910996-09e2-47ce-93ce-f641be916c8f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhXrNwGO {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhXrNwGO" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a61661a-ac80-4cfc-bed6-1c4355f4f991]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhXrNwGO'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0f480-3e9b-403a-9572-b73d76086927]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152cace-425d-4d72-877b-51a094d65d5f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:48:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:48:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236c4dc-9c4d-43b9-aacf-ca73c533bad0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260]
Apr 14 17:48:22 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260] successful.
Apr 14 17:48:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0d29fe-7e54-4b3d-a02b-8c5b50a82de3]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[94feeebf-f9a1-4e7d-a8ea-ba8cb7000e55]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:48:22 user nova-compute[71689]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 (non-flash)
Apr 14 17:48:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:48:22 user nova-compute[71689]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 (non-flash)
Apr 14 17:48:22 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc3cbe-7c69-4fa2-a5d0-5645710f2109]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:48:22 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhXrNwGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23836383333363433', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836383333363433', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1785581967',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1785581967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1785581967',id=44,image_ref='004b3625-95b1-4d74-8dc1-6e6c69ffff94',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-tcnwflk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-725648218',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:48:12Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=413746e7-f044-4604-9ed8-be8af08de775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.objects.instance [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'pci_devices' on Instance uuid 413746e7-f044-4604-9ed8-be8af08de775 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:48:23 user nova-compute[71689]:   <uuid>413746e7-f044-4604-9ed8-be8af08de775</uuid>
Apr 14 17:48:23 user nova-compute[71689]:   <name>instance-0000002c</name>
Apr 14 17:48:23 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:48:23 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:48:23 user nova-compute[71689]:   <metadata>
Apr 14 17:48:23 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:48:23 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:48:23 user nova-compute[71689]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1785581967</nova:name>
Apr 14 17:48:23 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:48:22</nova:creationTime>
Apr 14 17:48:23 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:48:23 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:48:23 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:48:23 user nova-compute[71689]:       <nova:owner>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:user uuid="f86537c1b58843d399db6cec00012c50">tempest-TestVolumeBootPattern-725648218-project-member</nova:user>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:project uuid="47e868622506423e80b158e7bf60c561">tempest-TestVolumeBootPattern-725648218</nova:project>
Apr 14 17:48:23 user nova-compute[71689]:       </nova:owner>
Apr 14 17:48:23 user nova-compute[71689]:       <nova:root type="image" uuid="004b3625-95b1-4d74-8dc1-6e6c69ffff94"/>
Apr 14 17:48:23 user nova-compute[71689]:       <nova:ports>
Apr 14 17:48:23 user nova-compute[71689]:         <nova:port uuid="fe473fa7-c36d-4db1-a628-aeceb4d6e82e">
Apr 14 17:48:23 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 17:48:23 user nova-compute[71689]:         </nova:port>
Apr 14 17:48:23 user nova-compute[71689]:       </nova:ports>
Apr 14 17:48:23 user nova-compute[71689]:     </nova:instance>
Apr 14 17:48:23 user nova-compute[71689]:   </metadata>
Apr 14 17:48:23 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:48:23 user nova-compute[71689]:     <system>
Apr 14 17:48:23 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:48:23 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:48:23 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:48:23 user nova-compute[71689]:       <entry name="serial">413746e7-f044-4604-9ed8-be8af08de775</entry>
Apr 14 17:48:23 user nova-compute[71689]:       <entry name="uuid">413746e7-f044-4604-9ed8-be8af08de775</entry>
Apr 14 17:48:23 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:48:23 user nova-compute[71689]:     </system>
Apr 14 17:48:23 user nova-compute[71689]:   </sysinfo>
Apr 14 17:48:23 user nova-compute[71689]:   <os>
Apr 14 17:48:23 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:48:23 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:48:23 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:48:23 user nova-compute[71689]:   </os>
Apr 14 17:48:23 user nova-compute[71689]:   <features>
Apr 14 17:48:23 user nova-compute[71689]:     <acpi/>
Apr 14 17:48:23 user nova-compute[71689]:     <apic/>
Apr 14 17:48:23 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:48:23 user nova-compute[71689]:   </features>
Apr 14 17:48:23 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:48:23 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:48:23 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:48:23 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:48:23 user nova-compute[71689]:   </clock>
Apr 14 17:48:23 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:48:23 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:48:23 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:48:23 user nova-compute[71689]:   </cpu>
Apr 14 17:48:23 user nova-compute[71689]:   <devices>
Apr 14 17:48:23 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:48:23 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:48:23 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:48:23 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:48:23 user nova-compute[71689]:       <serial>40324539-e194-41cf-8db5-9074b72172d2</serial>
Apr 14 17:48:23 user nova-compute[71689]:     </disk>
Apr 14 17:48:23 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:48:23 user nova-compute[71689]:       <mac address="fa:16:3e:5b:b3:d2"/>
Apr 14 17:48:23 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:48:23 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:48:23 user nova-compute[71689]:       <target dev="tapfe473fa7-c3"/>
Apr 14 17:48:23 user nova-compute[71689]:     </interface>
Apr 14 17:48:23 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:48:23 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/413746e7-f044-4604-9ed8-be8af08de775/console.log" append="off"/>
Apr 14 17:48:23 user nova-compute[71689]:     </serial>
Apr 14 17:48:23 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:48:23 user nova-compute[71689]:     <video>
Apr 14 17:48:23 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:48:23 user nova-compute[71689]:     </video>
Apr 14 17:48:23 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:48:23 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:48:23 user nova-compute[71689]:     </rng>
Apr 14 17:48:23 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:48:23 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:48:23 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:48:23 user nova-compute[71689]:     </memballoon>
Apr 14 17:48:23 user nova-compute[71689]:   </devices>
Apr 14 17:48:23 user nova-compute[71689]: </domain>
Apr 14 17:48:23 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1785581967',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1785581967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1785581967',id=44,image_ref='004b3625-95b1-4d74-8dc1-6e6c69ffff94',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-tcnwflk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-725648218',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:48:12Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=413746e7-f044-4604-9ed8-be8af08de775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG os_vif [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe473fa7-c3, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe473fa7-c3, col_values=(('external_ids', {'iface-id': 'fe473fa7-c36d-4db1-a628-aeceb4d6e82e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b3:d2', 'vm-uuid': '413746e7-f044-4604-9ed8-be8af08de775'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:48:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:24 user nova-compute[71689]: INFO os_vif [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3')
Apr 14 17:48:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:48:24 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No VIF found with MAC fa:16:3e:5b:b3:d2, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:25 user nova-compute[71689]: DEBUG nova.compute.manager [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] No waiting events found dispatching network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:48:25 user nova-compute[71689]: WARNING nova.compute.manager [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received unexpected event network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance with vm_state building and task_state spawning.
Apr 14 17:48:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494507.4766285, 413746e7-f044-4604-9ed8-be8af08de775 => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] VM Resumed (Lifecycle Event)
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Instance spawned successfully.
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494507.4810953, 413746e7-f044-4604-9ed8-be8af08de775 => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] VM Started (Lifecycle Event)
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:48:27 user nova-compute[71689]: INFO nova.compute.manager [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Took 16.12 seconds to build instance.
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:27 user nova-compute[71689]: DEBUG nova.compute.manager [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] No waiting events found dispatching network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:48:27 user nova-compute[71689]: WARNING nova.compute.manager [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received unexpected event network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance with vm_state active and task_state None.
Apr 14 17:48:27 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "413746e7-f044-4604-9ed8-be8af08de775" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.212s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:32 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:48:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:48:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:48:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:48:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:48:33 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:48:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:48:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:48:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:48:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:48:38 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:51 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:51 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:48:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid bcaa9cda-dd0b-4fa2-9820-8941995f22ed {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating instance_info_cache with network_info: [{"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-bcaa9cda-dd0b-4fa2-9820-8941995f22ed" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:48:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:48:58 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:48:58 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=26.183704376220703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 413746e7-f044-4604-9ed8-be8af08de775 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:48:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:48:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:48:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5013 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:49:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:49:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:49:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:52 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:52 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:49:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updating instance_info_cache with network_info: [{"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-413746e7-f044-4604-9ed8-be8af08de775" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:49:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:49:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:50:00 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:50:00 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=26.18310546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 413746e7-f044-4604-9ed8-be8af08de775 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "413746e7-f044-4604-9ed8-be8af08de775" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:02 user nova-compute[71689]: INFO nova.compute.manager [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Terminating instance
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-vif-unplugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] No waiting events found dispatching network-vif-unplugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.compute.manager [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-vif-unplugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:02 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Instance destroyed successfully.
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'resources' on Instance uuid 413746e7-f044-4604-9ed8-be8af08de775 {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1785581967',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1785581967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1785581967',id=44,image_ref='004b3625-95b1-4d74-8dc1-6e6c69ffff94',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-tcnwflk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-725648218',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:48:28Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=413746e7-f044-4604-9ed8-be8af08de775,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "address": "fa:16:3e:5b:b3:d2", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe473fa7-c3", "ovs_interfaceid": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_vif [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe473fa7-c3, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:02 user nova-compute[71689]: INFO os_vif [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b3:d2,bridge_name='br-int',has_traffic_filtering=True,id=fe473fa7-c36d-4db1-a628-aeceb4d6e82e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe473fa7-c3')
Apr 14 17:50:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhXrNwGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:50:02 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a9f59d-9603-4dcb-a36c-b59e3021cbc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:50:02 user nova-compute[71689]: No targets found.
Apr 14 17:50:02 user nova-compute[71689]: iSNS:
Apr 14 17:50:02 user nova-compute[71689]: No targets found.
Apr 14 17:50:02 user nova-compute[71689]: STATIC:
Apr 14 17:50:02 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2
Apr 14 17:50:02 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:50:02 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:50:02 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c
Apr 14 17:50:02 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:50:02 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:50:02 user nova-compute[71689]: FIRMWARE:
Apr 14 17:50:02 user nova-compute[71689]: No targets found.
Apr 14 17:50:02 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:50:02 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:50:02 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe62e8-a5ac-43af-825d-6cc64cbd3b56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c6c11c-2204-4b30-9f0c-02c231fe739b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:50:02 user nova-compute[71689]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 (non-flash)
Apr 14 17:50:02 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:50:02 user nova-compute[71689]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 (non-flash)
Apr 14 17:50:02 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c221bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4e6b9-00b8-4db6-ab8f-64c69ac3bdde]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:02 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce6cfeb-d5ac-4de4-badb-f669a3a7d322]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b503a40-b0e7-4912-bc83-499d49cfe0f4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e00b41-bbec-4c7f-9a20-5bd933332a0f]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4b73c8-b8d4-4a89-9447-0f25bc5a2ab2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fbf6f7-88e3-4768-8293-e6005870e5d8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260]
Apr 14 17:50:03 user nova-compute[71689]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2, portal: 172.16.0.220,3260] successful.
Apr 14 17:50:03 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40324539-e194-41cf-8db5-9074b72172d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd3e01-4849-46a5-aba3-c45a1f0bbff0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== disconnect_volume: return (324ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:50:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Deleting instance files /opt/stack/data/nova/instances/413746e7-f044-4604-9ed8-be8af08de775_del
Apr 14 17:50:03 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Deletion of /opt/stack/data/nova/instances/413746e7-f044-4604-9ed8-be8af08de775_del complete
Apr 14 17:50:03 user nova-compute[71689]: INFO nova.compute.manager [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 17:50:03 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:50:03 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:50:03 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Took 0.54 seconds to deallocate network for instance.
Apr 14 17:50:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Acquiring lock "413746e7-f044-4604-9ed8-be8af08de775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Lock "413746e7-f044-4604-9ed8-be8af08de775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] No waiting events found dispatching network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:04 user nova-compute[71689]: WARNING nova.compute.manager [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received unexpected event network-vif-plugged-fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance with vm_state active and task_state deleting.
Apr 14 17:50:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Received event network-vif-deleted-fe473fa7-c36d-4db1-a628-aeceb4d6e82e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:04 user nova-compute[71689]: INFO nova.compute.manager [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Took 0.92 seconds to detach 1 volumes for instance.
Apr 14 17:50:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Deleting volume: 40324539-e194-41cf-8db5-9074b72172d2 {{(pid=71689) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:50:04 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:50:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:05 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Deleted allocations for instance 413746e7-f044-4604-9ed8-be8af08de775
Apr 14 17:50:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "413746e7-f044-4604-9ed8-be8af08de775" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681494602.8371072, 413746e7-f044-4604-9ed8-be8af08de775 => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:50:17 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 413746e7-f044-4604-9ed8-be8af08de775] VM Stopped (Lifecycle Event)
Apr 14 17:50:17 user nova-compute[71689]: DEBUG nova.compute.manager [None req-2567b69c-eaea-4618-b10e-a4d277377743 None None] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:50:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:25 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:50:25 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:50:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:29 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:50:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:54 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:54 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:55 user nova-compute[71689]: INFO nova.compute.manager [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Terminating instance
Apr 14 17:50:55 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-unplugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-unplugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-unplugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Skipping network cache update for instance because it is being deleted. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Instance destroyed successfully.
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'resources' on Instance uuid bcaa9cda-dd0b-4fa2-9820-8941995f22ed {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1425264582',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1425264582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1425264582',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-3keyai3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:46:26Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=bcaa9cda-dd0b-4fa2-9820-8941995f22ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "address": "fa:16:3e:b6:0b:aa", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8c2b1a-57", "ovs_interfaceid": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_vif [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a8c2b1a-57, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:50:56 user nova-compute[71689]: INFO os_vif [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=7a8c2b1a-57dd-4e05-b244-3a5b880d5adf,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8c2b1a-57')
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKUoahzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:50:56 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68c9979-5cde-4b55-9116-46ed5be93844]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:50:56 user nova-compute[71689]: No targets found.
Apr 14 17:50:56 user nova-compute[71689]: iSNS:
Apr 14 17:50:56 user nova-compute[71689]: No targets found.
Apr 14 17:50:56 user nova-compute[71689]: STATIC:
Apr 14 17:50:56 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c
Apr 14 17:50:56 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:50:56 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:50:56 user nova-compute[71689]: FIRMWARE:
Apr 14 17:50:56 user nova-compute[71689]: No targets found.
Apr 14 17:50:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:50:56 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:50:56 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8720a-c616-4185-bf05-62c4688b259e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf7c0ba-9e67-440c-bbe4-eb8dcdab9b08]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:50:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c (non-flash)
Apr 14 17:50:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b1c679ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edb82e4-44d4-4b3d-abd5-f0cd74aa0832]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef83ae6-ae53-4d61-8c15-496f99e7d23c]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff8771-9783-4837-a418-478ddfa56f14]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bace5672-5ef2-4ab3-adc9-def52535b2c9]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8fce5b-b58b-4cc2-833a-326bc1981ea0]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a256864b-6c17-425e-a8c4-808bf80ec06c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260]
Apr 14 17:50:56 user nova-compute[71689]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c, portal: 172.16.0.220,3260] successful.
Apr 14 17:50:56 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e040b16e-d08b-4341-a869-cc4ee4629f1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0563cf4f-6000-42f4-aff1-b1414a9f040a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== disconnect_volume: return (311ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:50:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Deleting instance files /opt/stack/data/nova/instances/bcaa9cda-dd0b-4fa2-9820-8941995f22ed_del
Apr 14 17:50:56 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Deletion of /opt/stack/data/nova/instances/bcaa9cda-dd0b-4fa2-9820-8941995f22ed_del complete
Apr 14 17:50:56 user nova-compute[71689]: INFO nova.compute.manager [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 17:50:56 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:50:56 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:50:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:50:57 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:50:57 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Took 0.69 seconds to deallocate network for instance.
Apr 14 17:50:57 user nova-compute[71689]: DEBUG nova.compute.manager [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-deleted-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:58 user nova-compute[71689]: WARNING nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received unexpected event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with vm_state active and task_state deleting.
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:58 user nova-compute[71689]: WARNING nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received unexpected event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with vm_state active and task_state deleting.
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:58 user nova-compute[71689]: WARNING nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received unexpected event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with vm_state active and task_state deleting.
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-unplugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-unplugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-unplugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Acquiring lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] No waiting events found dispatching network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:50:58 user nova-compute[71689]: WARNING nova.compute.manager [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Received unexpected event network-vif-plugged-7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance with vm_state active and task_state deleting.
Apr 14 17:50:58 user nova-compute[71689]: INFO nova.compute.manager [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Took 0.76 seconds to detach 1 volumes for instance.
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Deleting volume: e040b16e-d08b-4341-a869-cc4ee4629f1c {{(pid=71689) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:50:58 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Deleted allocations for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed
Apr 14 17:50:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "bcaa9cda-dd0b-4fa2-9820-8941995f22ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.097s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:51:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:51:02 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:51:02 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=26.18191909790039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:51:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:51:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:05 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:11 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681494656.4861004, bcaa9cda-dd0b-4fa2-9820-8941995f22ed => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:51:11 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] VM Stopped (Lifecycle Event)
Apr 14 17:51:11 user nova-compute[71689]: DEBUG nova.compute.manager [None req-43f23340-67a7-436c-b7c4-9952b14cbfa0 None None] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:51:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "eb7c2884-b149-448d-b00e-35962ae3386d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:51:53 user nova-compute[71689]: INFO nova.compute.claims [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Claim successful on node user
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:51:53 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:51:53 user nova-compute[71689]: INFO nova.virt.block_device [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Booting with volume 6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 at /dev/vda
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.policy [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG os_brick.utils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a761611-940a-4dd0-b6be-2bd1acf85242]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08d6532-84f9-4946-95c7-a67c9fdc676e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aef62b-0a3d-4ffe-9e5f-70f978af8f38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8653a40b-93b1-43a4-ba0c-1c95f374a31e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:51:53 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:51:53 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff371c47-4061-4420-9573-699a08f46bdc]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG os_brick.utils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:51:53 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updating existing volume attachment record: d55898da-999f-4d8f-bdf6-ba7ec4ba346f {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:51:54 user nova-compute[71689]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Successfully created port: 719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Successfully updated port: 719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquired lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-changed-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.compute.manager [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Refreshing instance network info cache due to event network-changed-719203df-3d6c-4ded-8913-07b73fd3c374. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Acquiring lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updating instance_info_cache with network_info: [{"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Releasing lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Instance network_info: |[{"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Acquired lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Refreshing network info cache for port 719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updated VIF entry in instance network info cache for port 719203df-3d6c-4ded-8913-07b73fd3c374. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG nova.network.neutron [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updating instance_info_cache with network_info: [{"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:51:55 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Releasing lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Skipping network cache update for instance because it is Building. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:51:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:52:00 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:52:01 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Creating image(s)
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Ensure instance console log exists: /opt/stack/data/nova/instances/eb7c2884-b149-448d-b00e-35962ae3386d/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Start _get_guest_xml network_info=[{"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb7c2884-b149-448d-b00e-35962ae3386d', 'attached_at': '', 'detached_at': '', 'volume_id': '6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'serial': '6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd55898da-999f-4d8f-bdf6-ba7ec4ba346f', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:52:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:52:01 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:52:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:52:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:52:01 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a772a-8f79-42ba-8a7a-7b4a1c46055f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:52:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f0031d-1c0a-470a-b03c-f6261b62b9e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6] added
Apr 14 17:52:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f6e28-2fc8-4b7e-8ba9-824d2eaa7d0e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12cd86f-1f2f-4d0a-a5c2-698d2a9679d9]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olwNhAvU {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olwNhAvU" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0827d6bd-41e2-412c-b3ec-e7b69918227b]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'olwNhAvU'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8999733-4cf6-4bc3-9ea9-5562270faa0a]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87dd21-83c0-409e-b8b0-df8c2a69fba1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:52:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:52:01 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:52:01 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:52:01 user nova-compute[71689]: 
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2be02-902c-4211-8ab6-f91cc8f848a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]
Apr 14 17:52:01 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.
Apr 14 17:52:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b4070-4a95-4486-ac93-1e9a425584b8]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eb277c-4826-491e-a3be-979eead2f697]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:52:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:52:01 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f8854-3b37-4c4c-b035-cc6b2e35b328]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:52:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23339323136356338', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339323136356338', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2000935952',display_name='tempest-TestVolumeBootPattern-server-2000935952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2000935952',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-koipflkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:51:54Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=eb7c2884-b149-448d-b00e-35962ae3386d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'pci_devices' on Instance uuid eb7c2884-b149-448d-b00e-35962ae3386d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:52:02 user nova-compute[71689]:   <uuid>eb7c2884-b149-448d-b00e-35962ae3386d</uuid>
Apr 14 17:52:02 user nova-compute[71689]:   <name>instance-0000002d</name>
Apr 14 17:52:02 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:52:02 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:52:02 user nova-compute[71689]:   <metadata>
Apr 14 17:52:02 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:52:02 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:52:02 user nova-compute[71689]:       <nova:name>tempest-TestVolumeBootPattern-server-2000935952</nova:name>
Apr 14 17:52:02 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:52:01</nova:creationTime>
Apr 14 17:52:02 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:52:02 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:52:02 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:52:02 user nova-compute[71689]:       <nova:owner>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:user uuid="f86537c1b58843d399db6cec00012c50">tempest-TestVolumeBootPattern-725648218-project-member</nova:user>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:project uuid="47e868622506423e80b158e7bf60c561">tempest-TestVolumeBootPattern-725648218</nova:project>
Apr 14 17:52:02 user nova-compute[71689]:       </nova:owner>
Apr 14 17:52:02 user nova-compute[71689]:       <nova:ports>
Apr 14 17:52:02 user nova-compute[71689]:         <nova:port uuid="719203df-3d6c-4ded-8913-07b73fd3c374">
Apr 14 17:52:02 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 17:52:02 user nova-compute[71689]:         </nova:port>
Apr 14 17:52:02 user nova-compute[71689]:       </nova:ports>
Apr 14 17:52:02 user nova-compute[71689]:     </nova:instance>
Apr 14 17:52:02 user nova-compute[71689]:   </metadata>
Apr 14 17:52:02 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:52:02 user nova-compute[71689]:     <system>
Apr 14 17:52:02 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:52:02 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:52:02 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:52:02 user nova-compute[71689]:       <entry name="serial">eb7c2884-b149-448d-b00e-35962ae3386d</entry>
Apr 14 17:52:02 user nova-compute[71689]:       <entry name="uuid">eb7c2884-b149-448d-b00e-35962ae3386d</entry>
Apr 14 17:52:02 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:52:02 user nova-compute[71689]:     </system>
Apr 14 17:52:02 user nova-compute[71689]:   </sysinfo>
Apr 14 17:52:02 user nova-compute[71689]:   <os>
Apr 14 17:52:02 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:52:02 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:52:02 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:52:02 user nova-compute[71689]:   </os>
Apr 14 17:52:02 user nova-compute[71689]:   <features>
Apr 14 17:52:02 user nova-compute[71689]:     <acpi/>
Apr 14 17:52:02 user nova-compute[71689]:     <apic/>
Apr 14 17:52:02 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:52:02 user nova-compute[71689]:   </features>
Apr 14 17:52:02 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:52:02 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:52:02 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:52:02 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:52:02 user nova-compute[71689]:   </clock>
Apr 14 17:52:02 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:52:02 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:52:02 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:52:02 user nova-compute[71689]:   </cpu>
Apr 14 17:52:02 user nova-compute[71689]:   <devices>
Apr 14 17:52:02 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:52:02 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:52:02 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:52:02 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:52:02 user nova-compute[71689]:       <serial>6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6</serial>
Apr 14 17:52:02 user nova-compute[71689]:     </disk>
Apr 14 17:52:02 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:52:02 user nova-compute[71689]:       <mac address="fa:16:3e:52:e2:bf"/>
Apr 14 17:52:02 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:52:02 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:52:02 user nova-compute[71689]:       <target dev="tap719203df-3d"/>
Apr 14 17:52:02 user nova-compute[71689]:     </interface>
Apr 14 17:52:02 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:52:02 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/eb7c2884-b149-448d-b00e-35962ae3386d/console.log" append="off"/>
Apr 14 17:52:02 user nova-compute[71689]:     </serial>
Apr 14 17:52:02 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:52:02 user nova-compute[71689]:     <video>
Apr 14 17:52:02 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:52:02 user nova-compute[71689]:     </video>
Apr 14 17:52:02 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:52:02 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:52:02 user nova-compute[71689]:     </rng>
Apr 14 17:52:02 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:52:02 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:52:02 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:52:02 user nova-compute[71689]:     </memballoon>
Apr 14 17:52:02 user nova-compute[71689]:   </devices>
Apr 14 17:52:02 user nova-compute[71689]: </domain>
Apr 14 17:52:02 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2000935952',display_name='tempest-TestVolumeBootPattern-server-2000935952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2000935952',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-koipflkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:51:54Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=eb7c2884-b149-448d-b00e-35962ae3386d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG os_vif [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap719203df-3d, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap719203df-3d, col_values=(('external_ids', {'iface-id': '719203df-3d6c-4ded-8913-07b73fd3c374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:e2:bf', 'vm-uuid': 'eb7c2884-b149-448d-b00e-35962ae3386d'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:02 user nova-compute[71689]: INFO os_vif [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d')
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:52:02 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No VIF found with MAC fa:16:3e:52:e2:bf, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:03 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.manager [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] No waiting events found dispatching network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:52:04 user nova-compute[71689]: WARNING nova.compute.manager [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received unexpected event network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 for instance with vm_state building and task_state spawning.
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:04 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:52:04 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=26.180419921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance eb7c2884-b149-448d-b00e-35962ae3386d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:52:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494725.8989031, eb7c2884-b149-448d-b00e-35962ae3386d => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:52:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] VM Resumed (Lifecycle Event)
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:52:05 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Instance spawned successfully.
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:52:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494725.9000123, eb7c2884-b149-448d-b00e-35962ae3386d => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:52:05 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] VM Started (Lifecycle Event)
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:52:05 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:52:06 user nova-compute[71689]: INFO nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 14 17:52:06 user nova-compute[71689]: DEBUG nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:52:06 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:52:06 user nova-compute[71689]: INFO nova.compute.manager [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Took 12.76 seconds to build instance.
Apr 14 17:52:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "eb7c2884-b149-448d-b00e-35962ae3386d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.860s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:52:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:52:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:52:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:52:06 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:52:06 user nova-compute[71689]: DEBUG nova.compute.manager [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] No waiting events found dispatching network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:52:06 user nova-compute[71689]: WARNING nova.compute.manager [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received unexpected event network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 for instance with vm_state active and task_state None.
Apr 14 17:52:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:08 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:52:55 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:52:56 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid eb7c2884-b149-448d-b00e-35962ae3386d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:52:57 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updating instance_info_cache with network_info: [{"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:52:57 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:52:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:52:57 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:52:57 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:52:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:53:03 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:53:03 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=26.171382904052734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance eb7c2884-b149-448d-b00e-35962ae3386d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:53:03 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-changed-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Refreshing instance network info cache due to event network-changed-719203df-3d6c-4ded-8913-07b73fd3c374. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Acquiring lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Acquired lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG nova.network.neutron [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Refreshing network info cache for port 719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "eb7c2884-b149-448d-b00e-35962ae3386d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:45 user nova-compute[71689]: INFO nova.compute.manager [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Terminating instance
Apr 14 17:53:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG nova.network.neutron [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updated VIF entry in instance network info cache for port 719203df-3d6c-4ded-8913-07b73fd3c374. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG nova.network.neutron [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updating instance_info_cache with network_info: [{"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:53:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Releasing lock "refresh_cache-eb7c2884-b149-448d-b00e-35962ae3386d" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:53:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Instance destroyed successfully.
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.objects.instance [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'resources' on Instance uuid eb7c2884-b149-448d-b00e-35962ae3386d {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2000935952',display_name='tempest-TestVolumeBootPattern-server-2000935952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2000935952',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-koipflkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:52:06Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=eb7c2884-b149-448d-b00e-35962ae3386d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "719203df-3d6c-4ded-8913-07b73fd3c374", "address": "fa:16:3e:52:e2:bf", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap719203df-3d", "ovs_interfaceid": "719203df-3d6c-4ded-8913-07b73fd3c374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_vif [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap719203df-3d, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:53:46 user nova-compute[71689]: INFO os_vif [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:e2:bf,bridge_name='br-int',has_traffic_filtering=True,id=719203df-3d6c-4ded-8913-07b73fd3c374,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap719203df-3d')
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:53:46 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b8e346-afaa-4a30-b3bb-e09f57901414]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:53:46 user nova-compute[71689]: No targets found.
Apr 14 17:53:46 user nova-compute[71689]: iSNS:
Apr 14 17:53:46 user nova-compute[71689]: No targets found.
Apr 14 17:53:46 user nova-compute[71689]: STATIC:
Apr 14 17:53:46 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6
Apr 14 17:53:46 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:53:46 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:53:46 user nova-compute[71689]: FIRMWARE:
Apr 14 17:53:46 user nova-compute[71689]: No targets found.
Apr 14 17:53:46 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:53:46 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:53:46 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8667f7-be48-40c5-9b7c-f8d07fffd210]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0dc96f-ddf4-45e7-9f29-431faaa50083]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:53:46 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:53:46 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b560a05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d26e66-763d-4d15-8cf4-4ddd64693691]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cf84ca-ef3e-46f1-9d97-289af010ec73]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d4e840-06fa-4dc3-8c5b-3f2977a2f9f4]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9af94f-c22f-419e-aea0-90bedcf56a92]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[912adc53-35d4-4bcb-946d-b1be9fa42998]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[58766393-3c98-430d-9bf1-8efe5b09bf43]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]
Apr 14 17:53:46 user nova-compute[71689]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.
Apr 14 17:53:46 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9d77f-8ec5-454a-9378-3e3732cfac66]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== disconnect_volume: return (315ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:53:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Deleting instance files /opt/stack/data/nova/instances/eb7c2884-b149-448d-b00e-35962ae3386d_del
Apr 14 17:53:46 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Deletion of /opt/stack/data/nova/instances/eb7c2884-b149-448d-b00e-35962ae3386d_del complete
Apr 14 17:53:46 user nova-compute[71689]: INFO nova.compute.manager [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 17:53:46 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:53:46 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-vif-unplugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] No waiting events found dispatching network-vif-unplugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-vif-unplugged-719203df-3d6c-4ded-8913-07b73fd3c374 for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Acquiring lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Lock "eb7c2884-b149-448d-b00e-35962ae3386d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] No waiting events found dispatching network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:53:47 user nova-compute[71689]: WARNING nova.compute.manager [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received unexpected event network-vif-plugged-719203df-3d6c-4ded-8913-07b73fd3c374 for instance with vm_state active and task_state deleting.
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:53:47 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Took 0.89 seconds to deallocate network for instance.
Apr 14 17:53:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Received event network-vif-deleted-719203df-3d6c-4ded-8913-07b73fd3c374 {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:53:48 user nova-compute[71689]: INFO nova.compute.manager [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 17:53:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:53:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:53:48 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:53:48 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:53:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:48 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Deleted allocations for instance eb7c2884-b149-448d-b00e-35962ae3386d
Apr 14 17:53:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "eb7c2884-b149-448d-b00e-35962ae3386d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:53:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:55 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:56 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:53:56 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:53:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:53:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:53:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:53:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 17:54:01 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681494826.4163454, eb7c2884-b149-448d-b00e-35962ae3386d => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:54:01 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] VM Stopped (Lifecycle Event)
Apr 14 17:54:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c36d0fa5-1e35-4bb3-8d1b-19b79e9e20b0 None None] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:54:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:54:04 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:54:04 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=26.170520782470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:54:04 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:54:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:54:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:54:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:11 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:54:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:54:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:54:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:26 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:54:37 user nova-compute[71689]: INFO nova.compute.claims [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Claim successful on node user
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:54:37 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:54:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:54:37 user nova-compute[71689]: INFO nova.virt.block_device [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Booting with volume 6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 at /dev/vda
Apr 14 17:54:38 user nova-compute[71689]: DEBUG nova.policy [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG os_brick.utils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7e7ae-c52f-4bfd-aafc-5fa9c3fff9e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e9a2d-7b5c-4b75-8d94-9b35e455c20e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[973916f0-16d6-4176-9a5b-7181430d6097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c011ae64-45a2-40a7-af3d-c94447530034]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:54:38 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:54:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec7924-3c68-477c-95ca-ffe5687a17c8]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG os_brick.utils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating existing volume attachment record: ad677842-b461-4978-950b-e4f8a1913811 {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:54:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Successfully created port: b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Successfully updated port: b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-changed-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.compute.manager [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Refreshing instance network info cache due to event network-changed-b4433608-caeb-4871-adcd-2dd00c74035f. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Instance network_info: |[{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:54:39 user nova-compute[71689]: DEBUG nova.network.neutron [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Refreshing network info cache for port b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:54:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated VIF entry in instance network info cache for port b4433608-caeb-4871-adcd-2dd00c74035f. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:54:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:54:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:54:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:54:42 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Creating image(s)
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Ensure instance console log exists: /opt/stack/data/nova/instances/7a094ec7-baee-4f61-99e1-33e1e45e6fda/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Start _get_guest_xml network_info=[{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a094ec7-baee-4f61-99e1-33e1e45e6fda', 'attached_at': '', 'detached_at': '', 'volume_id': '6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'serial': '6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ad677842-b461-4978-950b-e4f8a1913811', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:54:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:54:42 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:54:42 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:54:42 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:54:42 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3219eee3-d517-455f-b25f-c196d6a2f5e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:54:42 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4dbfd-63e8-4c1d-889a-ceb756753913]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6] added
Apr 14 17:54:42 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53b1a94-ebab-4231-aab8-9b488ec414da]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac1c24e-1fb4-4c57-97b3-66bfeff92a8e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olwNhAvU {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olwNhAvU" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac6d68-bd20-4b88-8e68-beb7491ba7dc]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'olwNhAvU'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbf756-7cfd-48fd-9565-b13047b5dca2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c346f4a-58f5-4653-8dd0-775d4baef987]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:54:42 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:54:42 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 17:54:42 user nova-compute[71689]:  {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:54:42 user nova-compute[71689]: WARNING os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 17:54:42 user nova-compute[71689]: 
Apr 14 17:54:42 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f126d6-a975-45f0-bd97-899abb71ee25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]
Apr 14 17:54:43 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.
Apr 14 17:54:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d7c1b6-6533-41b9-8bdd-7156c1e8aacf]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc3d08-3d0e-49b6-bdde-e328a6f2472f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:54:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:54:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07fd061-407d-4c53-8d4d-26ac57150bc9]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:54:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23339323136356338', 'path': '/dev/sdb'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339323136356338', 'path': '/dev/sdb'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1556605766',display_name='tempest-TestVolumeBootPattern-server-1556605766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1556605766',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-2muolhsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:54:38Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=7a094ec7-baee-4f61-99e1-33e1e45e6fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a094ec7-baee-4f61-99e1-33e1e45e6fda {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:54:44 user nova-compute[71689]:   <uuid>7a094ec7-baee-4f61-99e1-33e1e45e6fda</uuid>
Apr 14 17:54:44 user nova-compute[71689]:   <name>instance-0000002e</name>
Apr 14 17:54:44 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:54:44 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:54:44 user nova-compute[71689]:   <metadata>
Apr 14 17:54:44 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:54:44 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:54:44 user nova-compute[71689]:       <nova:name>tempest-TestVolumeBootPattern-server-1556605766</nova:name>
Apr 14 17:54:44 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:54:42</nova:creationTime>
Apr 14 17:54:44 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:54:44 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:54:44 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:54:44 user nova-compute[71689]:       <nova:owner>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:user uuid="f86537c1b58843d399db6cec00012c50">tempest-TestVolumeBootPattern-725648218-project-member</nova:user>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:project uuid="47e868622506423e80b158e7bf60c561">tempest-TestVolumeBootPattern-725648218</nova:project>
Apr 14 17:54:44 user nova-compute[71689]:       </nova:owner>
Apr 14 17:54:44 user nova-compute[71689]:       <nova:ports>
Apr 14 17:54:44 user nova-compute[71689]:         <nova:port uuid="b4433608-caeb-4871-adcd-2dd00c74035f">
Apr 14 17:54:44 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 17:54:44 user nova-compute[71689]:         </nova:port>
Apr 14 17:54:44 user nova-compute[71689]:       </nova:ports>
Apr 14 17:54:44 user nova-compute[71689]:     </nova:instance>
Apr 14 17:54:44 user nova-compute[71689]:   </metadata>
Apr 14 17:54:44 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:54:44 user nova-compute[71689]:     <system>
Apr 14 17:54:44 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:54:44 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:54:44 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:54:44 user nova-compute[71689]:       <entry name="serial">7a094ec7-baee-4f61-99e1-33e1e45e6fda</entry>
Apr 14 17:54:44 user nova-compute[71689]:       <entry name="uuid">7a094ec7-baee-4f61-99e1-33e1e45e6fda</entry>
Apr 14 17:54:44 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:54:44 user nova-compute[71689]:     </system>
Apr 14 17:54:44 user nova-compute[71689]:   </sysinfo>
Apr 14 17:54:44 user nova-compute[71689]:   <os>
Apr 14 17:54:44 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:54:44 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:54:44 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:54:44 user nova-compute[71689]:   </os>
Apr 14 17:54:44 user nova-compute[71689]:   <features>
Apr 14 17:54:44 user nova-compute[71689]:     <acpi/>
Apr 14 17:54:44 user nova-compute[71689]:     <apic/>
Apr 14 17:54:44 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:54:44 user nova-compute[71689]:   </features>
Apr 14 17:54:44 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:54:44 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:54:44 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:54:44 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:54:44 user nova-compute[71689]:   </clock>
Apr 14 17:54:44 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:54:44 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:54:44 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:54:44 user nova-compute[71689]:   </cpu>
Apr 14 17:54:44 user nova-compute[71689]:   <devices>
Apr 14 17:54:44 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:54:44 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:54:44 user nova-compute[71689]:       <source dev="/dev/sdb"/>
Apr 14 17:54:44 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:54:44 user nova-compute[71689]:       <serial>6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6</serial>
Apr 14 17:54:44 user nova-compute[71689]:     </disk>
Apr 14 17:54:44 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:54:44 user nova-compute[71689]:       <mac address="fa:16:3e:2c:fc:60"/>
Apr 14 17:54:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:54:44 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:54:44 user nova-compute[71689]:       <target dev="tapb4433608-ca"/>
Apr 14 17:54:44 user nova-compute[71689]:     </interface>
Apr 14 17:54:44 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:54:44 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/7a094ec7-baee-4f61-99e1-33e1e45e6fda/console.log" append="off"/>
Apr 14 17:54:44 user nova-compute[71689]:     </serial>
Apr 14 17:54:44 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:54:44 user nova-compute[71689]:     <video>
Apr 14 17:54:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:54:44 user nova-compute[71689]:     </video>
Apr 14 17:54:44 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:54:44 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:54:44 user nova-compute[71689]:     </rng>
Apr 14 17:54:44 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:54:44 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:54:44 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:54:44 user nova-compute[71689]:     </memballoon>
Apr 14 17:54:44 user nova-compute[71689]:   </devices>
Apr 14 17:54:44 user nova-compute[71689]: </domain>
Apr 14 17:54:44 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1556605766',display_name='tempest-TestVolumeBootPattern-server-1556605766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1556605766',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-2muolhsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:54:38Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=7a094ec7-baee-4f61-99e1-33e1e45e6fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG os_vif [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4433608-ca, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4433608-ca, col_values=(('external_ids', {'iface-id': 'b4433608-caeb-4871-adcd-2dd00c74035f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:fc:60', 'vm-uuid': '7a094ec7-baee-4f61-99e1-33e1e45e6fda'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:44 user nova-compute[71689]: INFO os_vif [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca')
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:54:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No VIF found with MAC fa:16:3e:2c:fc:60, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG nova.compute.manager [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] No waiting events found dispatching network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:54:45 user nova-compute[71689]: WARNING nova.compute.manager [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received unexpected event network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f for instance with vm_state building and task_state spawning.
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494887.5077543, 7a094ec7-baee-4f61-99e1-33e1e45e6fda => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] VM Resumed (Lifecycle Event)
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Instance spawned successfully.
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681494887.5092955, 7a094ec7-baee-4f61-99e1-33e1e45e6fda => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] VM Started (Lifecycle Event)
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Took 4.86 seconds to spawn the instance on the hypervisor.
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:47 user nova-compute[71689]: DEBUG nova.compute.manager [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] No waiting events found dispatching network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:54:47 user nova-compute[71689]: WARNING nova.compute.manager [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received unexpected event network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f for instance with vm_state building and task_state spawning.
Apr 14 17:54:47 user nova-compute[71689]: INFO nova.compute.manager [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Took 10.06 seconds to build instance.
Apr 14 17:54:47 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.152s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:54:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:54:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 7a094ec7-baee-4f61-99e1-33e1e45e6fda {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:54:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:54:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:54:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:54:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:54:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:54:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:03 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:55:05 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:55:05 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=26.16881561279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:55:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:06 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:11 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:55:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:55:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:35 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 17:55:35 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 17:55:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:37 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 17:55:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:55:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:55:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:55:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:56 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 7a094ec7-baee-4f61-99e1-33e1e45e6fda {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:55:58 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:55:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:55:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:55:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:55:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:55:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:56:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:56:07 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:56:07 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=26.168228149414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing inventories for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating ProviderTree inventory for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Updating inventory in ProviderTree for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing aggregate associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, aggregates: None {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Refreshing trait associations for resource provider 4b579fd6-14ac-45a2-8022-c2739351dd91, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND {{(pid=71689) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:56:07 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:56:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:56:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:56:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:56:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:56:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:56:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:56:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:56:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:56:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:56:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-changed-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:56:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Refreshing instance network info cache due to event network-changed-b4433608-caeb-4871-adcd-2dd00c74035f. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:56:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:56:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:56:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Refreshing network info cache for port b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:56:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated VIF entry in instance network info cache for port b4433608-caeb-4871-adcd-2dd00c74035f. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:56:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:56:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:56:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:37 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Starting instance... {{(pid=71689) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 17:56:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:37 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:37 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71689) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 17:56:37 user nova-compute[71689]: INFO nova.compute.claims [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Claim successful on node user
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Start building networks asynchronously for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Allocating IP information in the background. {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] allocate_for_instance() {{(pid=71689) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 17:56:38 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Start building block device mappings for instance. {{(pid=71689) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 17:56:38 user nova-compute[71689]: INFO nova.virt.block_device [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Booting with volume 56dd664d-d444-40c1-8b62-667369a174b3 at /dev/vda
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.policy [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71689) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG os_brick.utils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[632c3e62-c82d-4d3d-ad65-db83bf8081a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1f7a4fcebdb\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[22104bfc-1186-4ac7-8dc0-28e6346147a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b00c87e-df1a-4b65-9b69-0f887f49369c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f178771f-6edd-4a17-8aa9-2c8856fa99d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Running cmd (subprocess): nvme version {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71689) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] nvme not present on system {{(pid=71689) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 17:56:38 user nova-compute[71689]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 17:56:38 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4989967-77df-4ea0-bdb3-c43e93147b5f]: (4, '') {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71689) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.lightos [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] LIGHTOS: no hostnqn found. {{(pid=71689) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG os_brick.utils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7a4fcebdb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:56:38 user nova-compute[71689]: DEBUG nova.virt.block_device [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating existing volume attachment record: c9fcb32a-6f7a-41fd-b706-83e818acc28a {{(pid=71689) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 17:56:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:39 user nova-compute[71689]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Successfully created port: 90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Successfully updated port: 90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquired lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Building network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-changed-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.compute.manager [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Refreshing instance network info cache due to event network-changed-90bb3866-d29e-4bcb-8927-e5536e59715e. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Acquiring lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Instance cache missing network info. {{(pid=71689) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating instance_info_cache with network_info: [{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Releasing lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Instance network_info: |[{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71689) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Acquired lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Refreshing network info cache for port 90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updated VIF entry in instance network info cache for port 90bb3866-d29e-4bcb-8927-e5536e59715e. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG nova.network.neutron [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating instance_info_cache with network_info: [{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:56:40 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Releasing lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:56:41 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Start spawning the instance on the hypervisor. {{(pid=71689) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Creating instance directory {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 17:56:43 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Creating image(s)
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Did not create local disks {{(pid=71689) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Ensure instance console log exists: /opt/stack/data/nova/instances/7ee241cb-0eeb-4aa3-ab54-89427b437a3a/console.log {{(pid=71689) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Start _get_guest_xml network_info=[{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVrRMXBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ee241cb-0eeb-4aa3-ab54-89427b437a3a', 'attached_at': '', 'detached_at': '', 'volume_id': '56dd664d-d444-40c1-8b62-667369a174b3', 'serial': '56dd664d-d444-40c1-8b62-667369a174b3'}, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c9fcb32a-6f7a-41fd-b706-83e818acc28a', 'volume_type': None} {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 17:56:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:56:43 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71689) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T17:00:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Got 1 possible topologies {{(pid=71689) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71689) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Calling os-brick to attach iSCSI Volume {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVrRMXBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:56:43 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:56:43 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:56:43 user nova-compute[71689]: INFO os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae158cb3-80fa-4f7b-81dc-f582cf1bba02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 17:56:43 user nova-compute[71689]:  {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe837c4-6e65-4dfb-b034-c9f31484afe8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3] added\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3] added
Apr 14 17:56:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d491f-e4d2-43db-aaf0-63a2cd610a94]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5dd640-7214-4714-aee0-801d226cc4b2]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVrRMXBj {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVrRMXBj" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb42adc-d862-47cd-a754-1cce29f4c3ce]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVrRMXBj'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2065d-f96f-477e-8d82-8e878126e68f]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ffda9d-b480-49a7-a9c8-a93e769a3ed3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:56:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:56:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --login {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b293cc-fd07-42d8-8d98-cb404fe4e05f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260]
Apr 14 17:56:43 user nova-compute[71689]: Login to [iface: default, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260] successful.
Apr 14 17:56:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[850c8920-97e8-4823-958c-89f39b4e82fe]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[555f6a44-2972-42d3-85ce-33bb9f572fc1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:56:43 user nova-compute[71689]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 (non-flash)
Apr 14 17:56:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:56:43 user nova-compute[71689]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 (non-flash)
Apr 14 17:56:43 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to 172.16.0.220:3260 {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71689) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71689) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[607266aa-20f1-4f1d-b178-f17ec66c98fb]: (4, ('- - 0', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:56:43 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71689) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVrRMXBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71689) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26437383330393135', 'path': '/dev/sdc'} {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437383330393135', 'path': '/dev/sdc'} {{(pid=71689) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-583350731',display_name='tempest-TestVolumeBootPattern-server-583350731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-583350731',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-geve8g1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:56:38Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=7ee241cb-0eeb-4aa3-ab54-89427b437a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71689) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.objects.instance [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ee241cb-0eeb-4aa3-ab54-89427b437a3a {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 17:56:44 user nova-compute[71689]:   <uuid>7ee241cb-0eeb-4aa3-ab54-89427b437a3a</uuid>
Apr 14 17:56:44 user nova-compute[71689]:   <name>instance-0000002f</name>
Apr 14 17:56:44 user nova-compute[71689]:   <memory>131072</memory>
Apr 14 17:56:44 user nova-compute[71689]:   <vcpu>1</vcpu>
Apr 14 17:56:44 user nova-compute[71689]:   <metadata>
Apr 14 17:56:44 user nova-compute[71689]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 17:56:44 user nova-compute[71689]:       <nova:package version="0.0.0"/>
Apr 14 17:56:44 user nova-compute[71689]:       <nova:name>tempest-TestVolumeBootPattern-server-583350731</nova:name>
Apr 14 17:56:44 user nova-compute[71689]:       <nova:creationTime>2023-04-14 17:56:43</nova:creationTime>
Apr 14 17:56:44 user nova-compute[71689]:       <nova:flavor name="m1.nano">
Apr 14 17:56:44 user nova-compute[71689]:         <nova:memory>128</nova:memory>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:disk>1</nova:disk>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:swap>0</nova:swap>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:vcpus>1</nova:vcpus>
Apr 14 17:56:44 user nova-compute[71689]:       </nova:flavor>
Apr 14 17:56:44 user nova-compute[71689]:       <nova:owner>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:user uuid="f86537c1b58843d399db6cec00012c50">tempest-TestVolumeBootPattern-725648218-project-member</nova:user>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:project uuid="47e868622506423e80b158e7bf60c561">tempest-TestVolumeBootPattern-725648218</nova:project>
Apr 14 17:56:44 user nova-compute[71689]:       </nova:owner>
Apr 14 17:56:44 user nova-compute[71689]:       <nova:ports>
Apr 14 17:56:44 user nova-compute[71689]:         <nova:port uuid="90bb3866-d29e-4bcb-8927-e5536e59715e">
Apr 14 17:56:44 user nova-compute[71689]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 17:56:44 user nova-compute[71689]:         </nova:port>
Apr 14 17:56:44 user nova-compute[71689]:       </nova:ports>
Apr 14 17:56:44 user nova-compute[71689]:     </nova:instance>
Apr 14 17:56:44 user nova-compute[71689]:   </metadata>
Apr 14 17:56:44 user nova-compute[71689]:   <sysinfo type="smbios">
Apr 14 17:56:44 user nova-compute[71689]:     <system>
Apr 14 17:56:44 user nova-compute[71689]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 17:56:44 user nova-compute[71689]:       <entry name="product">OpenStack Nova</entry>
Apr 14 17:56:44 user nova-compute[71689]:       <entry name="version">0.0.0</entry>
Apr 14 17:56:44 user nova-compute[71689]:       <entry name="serial">7ee241cb-0eeb-4aa3-ab54-89427b437a3a</entry>
Apr 14 17:56:44 user nova-compute[71689]:       <entry name="uuid">7ee241cb-0eeb-4aa3-ab54-89427b437a3a</entry>
Apr 14 17:56:44 user nova-compute[71689]:       <entry name="family">Virtual Machine</entry>
Apr 14 17:56:44 user nova-compute[71689]:     </system>
Apr 14 17:56:44 user nova-compute[71689]:   </sysinfo>
Apr 14 17:56:44 user nova-compute[71689]:   <os>
Apr 14 17:56:44 user nova-compute[71689]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 17:56:44 user nova-compute[71689]:     <boot dev="hd"/>
Apr 14 17:56:44 user nova-compute[71689]:     <smbios mode="sysinfo"/>
Apr 14 17:56:44 user nova-compute[71689]:   </os>
Apr 14 17:56:44 user nova-compute[71689]:   <features>
Apr 14 17:56:44 user nova-compute[71689]:     <acpi/>
Apr 14 17:56:44 user nova-compute[71689]:     <apic/>
Apr 14 17:56:44 user nova-compute[71689]:     <vmcoreinfo/>
Apr 14 17:56:44 user nova-compute[71689]:   </features>
Apr 14 17:56:44 user nova-compute[71689]:   <clock offset="utc">
Apr 14 17:56:44 user nova-compute[71689]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 17:56:44 user nova-compute[71689]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 17:56:44 user nova-compute[71689]:     <timer name="hpet" present="no"/>
Apr 14 17:56:44 user nova-compute[71689]:   </clock>
Apr 14 17:56:44 user nova-compute[71689]:   <cpu mode="custom" match="exact">
Apr 14 17:56:44 user nova-compute[71689]:     <model>Nehalem</model>
Apr 14 17:56:44 user nova-compute[71689]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 17:56:44 user nova-compute[71689]:   </cpu>
Apr 14 17:56:44 user nova-compute[71689]:   <devices>
Apr 14 17:56:44 user nova-compute[71689]:     <disk type="block" device="disk">
Apr 14 17:56:44 user nova-compute[71689]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 17:56:44 user nova-compute[71689]:       <source dev="/dev/sdc"/>
Apr 14 17:56:44 user nova-compute[71689]:       <target dev="vda" bus="virtio"/>
Apr 14 17:56:44 user nova-compute[71689]:       <serial>56dd664d-d444-40c1-8b62-667369a174b3</serial>
Apr 14 17:56:44 user nova-compute[71689]:     </disk>
Apr 14 17:56:44 user nova-compute[71689]:     <interface type="ethernet">
Apr 14 17:56:44 user nova-compute[71689]:       <mac address="fa:16:3e:47:dc:41"/>
Apr 14 17:56:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:56:44 user nova-compute[71689]:       <mtu size="1442"/>
Apr 14 17:56:44 user nova-compute[71689]:       <target dev="tap90bb3866-d2"/>
Apr 14 17:56:44 user nova-compute[71689]:     </interface>
Apr 14 17:56:44 user nova-compute[71689]:     <serial type="pty">
Apr 14 17:56:44 user nova-compute[71689]:       <log file="/opt/stack/data/nova/instances/7ee241cb-0eeb-4aa3-ab54-89427b437a3a/console.log" append="off"/>
Apr 14 17:56:44 user nova-compute[71689]:     </serial>
Apr 14 17:56:44 user nova-compute[71689]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 17:56:44 user nova-compute[71689]:     <video>
Apr 14 17:56:44 user nova-compute[71689]:       <model type="virtio"/>
Apr 14 17:56:44 user nova-compute[71689]:     </video>
Apr 14 17:56:44 user nova-compute[71689]:     <rng model="virtio">
Apr 14 17:56:44 user nova-compute[71689]:       <backend model="random">/dev/urandom</backend>
Apr 14 17:56:44 user nova-compute[71689]:     </rng>
Apr 14 17:56:44 user nova-compute[71689]:     <controller type="usb" index="0" model="none"/>
Apr 14 17:56:44 user nova-compute[71689]:     <memballoon model="virtio">
Apr 14 17:56:44 user nova-compute[71689]:       <stats period="10"/>
Apr 14 17:56:44 user nova-compute[71689]:     </memballoon>
Apr 14 17:56:44 user nova-compute[71689]:   </devices>
Apr 14 17:56:44 user nova-compute[71689]: </domain>
Apr 14 17:56:44 user nova-compute[71689]:  {{(pid=71689) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-583350731',display_name='tempest-TestVolumeBootPattern-server-583350731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-583350731',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-geve8g1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T17:56:38Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=7ee241cb-0eeb-4aa3-ab54-89427b437a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG os_vif [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2') {{(pid=71689) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90bb3866-d2, may_exist=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90bb3866-d2, col_values=(('external_ids', {'iface-id': '90bb3866-d29e-4bcb-8927-e5536e59715e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:dc:41', 'vm-uuid': '7ee241cb-0eeb-4aa3-ab54-89427b437a3a'}),)) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:44 user nova-compute[71689]: INFO os_vif [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2')
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71689) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 17:56:44 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] No VIF found with MAC fa:16:3e:47:dc:41, not building metadata {{(pid=71689) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 17:56:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG nova.compute.manager [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] No waiting events found dispatching network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:56:46 user nova-compute[71689]: WARNING nova.compute.manager [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received unexpected event network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e for instance with vm_state building and task_state spawning.
Apr 14 17:56:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:46 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681495008.0635388, 7ee241cb-0eeb-4aa3-ab54-89427b437a3a => Resumed> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] VM Resumed (Lifecycle Event)
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Instance event wait completed in 0 seconds for  {{(pid=71689) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Guest created on hypervisor {{(pid=71689) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Instance spawned successfully.
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] No waiting events found dispatching network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:56:48 user nova-compute[71689]: WARNING nova.compute.manager [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received unexpected event network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e for instance with vm_state building and task_state spawning.
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Found default for hw_cdrom_bus of ide {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Found default for hw_disk_bus of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Found default for hw_input_bus of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Found default for hw_pointer_model of None {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Found default for hw_video_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Found default for hw_vif_model of virtio {{(pid=71689) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.virt.driver [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] Emitting event <LifecycleEvent: 1681495008.0650766, 7ee241cb-0eeb-4aa3-ab54-89427b437a3a => Started> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] VM Started (Lifecycle Event)
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71689) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.compute.manager [None req-e0c0faed-5103-43f2-83ba-1ee144a72c59 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 14 17:56:48 user nova-compute[71689]: DEBUG nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:56:48 user nova-compute[71689]: INFO nova.compute.manager [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Took 10.30 seconds to build instance.
Apr 14 17:56:48 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.397s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:56:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:51 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 7a094ec7-baee-4f61-99e1-33e1e45e6fda {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:56:59 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:57:01 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:01 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:57:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:05 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:06 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:57:08 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:57:08 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=26.16631317138672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:57:08 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:57:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:14 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:15 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:16 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:20 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:57:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:57:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:57:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:57:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:57:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:34 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:39 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:57:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:57:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:44 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:57:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:57:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:49 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:57:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:57:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:57:54 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:57:58 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:57:59 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating instance_info_cache with network_info: [{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:58:00 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:58:01 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:58:04 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:58:09 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:58:09 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=26.16571807861328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:58:09 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:14 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:16 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:58:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:58:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:58:19 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:22 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:58:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:58:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:58:24 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-changed-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG nova.compute.manager [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Refreshing instance network info cache due to event network-changed-90bb3866-d29e-4bcb-8927-e5536e59715e. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Acquiring lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Acquired lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Refreshing network info cache for port 90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updated VIF entry in instance network info cache for port 90bb3866-d29e-4bcb-8927-e5536e59715e. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG nova.network.neutron [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating instance_info_cache with network_info: [{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:58:30 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Releasing lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:31 user nova-compute[71689]: INFO nova.compute.manager [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Terminating instance
Apr 14 17:58:31 user nova-compute[71689]: DEBUG nova.compute.manager [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:58:31 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-changed-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.compute.manager [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Refreshing instance network info cache due to event network-changed-90bb3866-d29e-4bcb-8927-e5536e59715e. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Acquiring lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Acquired lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Refreshing network info cache for port 90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Instance destroyed successfully.
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.objects.instance [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'resources' on Instance uuid 7ee241cb-0eeb-4aa3-ab54-89427b437a3a {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updated VIF entry in instance network info cache for port 90bb3866-d29e-4bcb-8927-e5536e59715e. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.network.neutron [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating instance_info_cache with network_info: [{"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-583350731',display_name='tempest-TestVolumeBootPattern-server-583350731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-583350731',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:56:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-geve8g1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:56:48Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=7ee241cb-0eeb-4aa3-ab54-89427b437a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "90bb3866-d29e-4bcb-8927-e5536e59715e", "address": "fa:16:3e:47:dc:41", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb3866-d2", "ovs_interfaceid": "90bb3866-d29e-4bcb-8927-e5536e59715e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_vif [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90bb3866-d2, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Releasing lock "refresh_cache-7ee241cb-0eeb-4aa3-ab54-89427b437a3a" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:32 user nova-compute[71689]: INFO os_vif [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:dc:41,bridge_name='br-int',has_traffic_filtering=True,id=90bb3866-d29e-4bcb-8927-e5536e59715e,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb3866-d2')
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVrRMXBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:58:32 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20c467-4558-4ede-a126-c6209c93441c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:58:32 user nova-compute[71689]: No targets found.
Apr 14 17:58:32 user nova-compute[71689]: iSNS:
Apr 14 17:58:32 user nova-compute[71689]: No targets found.
Apr 14 17:58:32 user nova-compute[71689]: STATIC:
Apr 14 17:58:32 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3
Apr 14 17:58:32 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:58:32 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:58:32 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6
Apr 14 17:58:32 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:58:32 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:58:32 user nova-compute[71689]: FIRMWARE:
Apr 14 17:58:32 user nova-compute[71689]: No targets found.
Apr 14 17:58:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:58:32 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:58:32 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a669e33-64a3-438e-b52f-06236e6ac3a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa14175-2d0f-4960-bfe3-adf4517d50e4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:58:32 user nova-compute[71689]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 (non-flash)
Apr 14 17:58:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:58:32 user nova-compute[71689]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 (non-flash)
Apr 14 17:58:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c221990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3'): ({'sdc'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Removing single pathed devices sdc {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdd319-4586-4baa-a084-16ad04e14da5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6190d61c-94f5-433d-8134-bddcec519f39]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flushing IO for device /dev/sdc {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c27147-1937-48f9-b77c-521d97d7080d]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1cdc48-5188-4f7f-941e-a7a117628c7a]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] SCSI volumes sdc have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26437383330393135', '/dev/disk/by-id/scsi-1SCST_BIOd5ca1c8f-d7830915bd0a1756', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d5ca1c8f') {{(pid=81988) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71c1b6-6fa5-4667-ac7d-76199998b498]: (4, None) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d8e38-b483-4198-b2bb-074c319a3a79]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5e5fb8-fc7a-421c-8b53-277935f9d1bb]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260]
Apr 14 17:58:32 user nova-compute[71689]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3, portal: 172.16.0.220,3260] successful.
Apr 14 17:58:32 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56dd664d-d444-40c1-8b62-667369a174b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243d368-428d-43da-92f4-bdf562dbf695]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== disconnect_volume: return (313ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:58:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Deleting instance files /opt/stack/data/nova/instances/7ee241cb-0eeb-4aa3-ab54-89427b437a3a_del
Apr 14 17:58:32 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Deletion of /opt/stack/data/nova/instances/7ee241cb-0eeb-4aa3-ab54-89427b437a3a_del complete
Apr 14 17:58:32 user nova-compute[71689]: INFO nova.compute.manager [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 17:58:32 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:58:32 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:58:33 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:58:33 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Took 0.67 seconds to deallocate network for instance.
Apr 14 17:58:33 user nova-compute[71689]: DEBUG nova.compute.manager [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-vif-deleted-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-vif-unplugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] No waiting events found dispatching network-vif-unplugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-vif-unplugged-90bb3866-d29e-4bcb-8927-e5536e59715e for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received event network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Acquiring lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.compute.manager [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] No waiting events found dispatching network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:58:34 user nova-compute[71689]: WARNING nova.compute.manager [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Received unexpected event network-vif-plugged-90bb3866-d29e-4bcb-8927-e5536e59715e for instance with vm_state active and task_state deleting.
Apr 14 17:58:34 user nova-compute[71689]: INFO nova.compute.manager [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:34 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Deleted allocations for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a
Apr 14 17:58:34 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7ee241cb-0eeb-4aa3-ab54-89427b437a3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:58:36 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:37 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:58:42 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681495112.5547597, 7ee241cb-0eeb-4aa3-ab54-89427b437a3a => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:58:47 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] VM Stopped (Lifecycle Event)
Apr 14 17:58:47 user nova-compute[71689]: DEBUG nova.compute.manager [None req-e4550a8c-f66a-477b-90b8-26dee27d4169 None None] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 17:58:47 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:58:52 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:57 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:58:59 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Forcefully refreshing network info cache for instance {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.objects.instance [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lazy-loading 'info_cache' on Instance uuid 7a094ec7-baee-4f61-99e1-33e1e45e6fda {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.network.neutron [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated the network info_cache for instance {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 17:59:02 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:59:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:07 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:10 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71689) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 17:59:11 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:59:11 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=26.16480255126953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71689) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 17:59:11 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:12 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:59:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:17 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:17 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 17:59:21 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:22 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 17:59:27 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-changed-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG nova.compute.manager [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Refreshing instance network info cache due to event network-changed-b4433608-caeb-4871-adcd-2dd00c74035f. {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Acquiring lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Acquired lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Refreshing network info cache for port b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:29 user nova-compute[71689]: INFO nova.compute.manager [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Terminating instance
Apr 14 17:59:29 user nova-compute[71689]: DEBUG nova.compute.manager [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Start destroying the instance on the hypervisor. {{(pid=71689) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updated VIF entry in instance network info cache for port b4433608-caeb-4871-adcd-2dd00c74035f. {{(pid=71689) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG nova.network.neutron [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [{"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:59:29 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Releasing lock "refresh_cache-7a094ec7-baee-4f61-99e1-33e1e45e6fda" {{(pid=71689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 17:59:30 user nova-compute[71689]: INFO nova.virt.libvirt.driver [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Instance destroyed successfully.
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.objects.instance [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lazy-loading 'resources' on Instance uuid 7a094ec7-baee-4f61-99e1-33e1e45e6fda {{(pid=71689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.vif [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T17:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1556605766',display_name='tempest-TestVolumeBootPattern-server-1556605766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1556605766',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg==',key_name='tempest-TestVolumeBootPattern-1742880846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T17:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e868622506423e80b158e7bf60c561',ramdisk_id='',reservation_id='r-2muolhsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-725648218',owner_user_name='tempest-TestVolumeBootPattern-725648218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T17:54:48Z,user_data=None,user_id='f86537c1b58843d399db6cec00012c50',uuid=7a094ec7-baee-4f61-99e1-33e1e45e6fda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converting VIF {"id": "b4433608-caeb-4871-adcd-2dd00c74035f", "address": "fa:16:3e:2c:fc:60", "network": {"id": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-572703395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e868622506423e80b158e7bf60c561", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4433608-ca", "ovs_interfaceid": "b4433608-caeb-4871-adcd-2dd00c74035f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.network.os_vif_util [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca') {{(pid=71689) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_vif [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca') {{(pid=71689) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4433608-ca, bridge=br-int, if_exists=True) {{(pid=71689) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:30 user nova-compute[71689]: INFO os_vif [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:fc:60,bridge_name='br-int',has_traffic_filtering=True,id=b4433608-caeb-4871-adcd-2dd00c74035f,network=Network(e0a9bb9b-0523-41d9-a8ea-0c8772015edf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4433608-ca')
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] calling os-brick to detach iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9b4c666680>, {'target_iqn': 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olwNhAvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 17:59:30 user nova-compute[71689]: WARNING os_brick.initiator.connectors.base [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[363f1472-fbaa-48a6-bdfb-5e493a68cd12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 17:59:30 user nova-compute[71689]: No targets found.
Apr 14 17:59:30 user nova-compute[71689]: iSNS:
Apr 14 17:59:30 user nova-compute[71689]: No targets found.
Apr 14 17:59:30 user nova-compute[71689]: STATIC:
Apr 14 17:59:30 user nova-compute[71689]: Target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6
Apr 14 17:59:30 user nova-compute[71689]:         Portal: 172.16.0.220:3260,-1
Apr 14 17:59:30 user nova-compute[71689]:                 Iface Name: default
Apr 14 17:59:30 user nova-compute[71689]: FIRMWARE:
Apr 14 17:59:30 user nova-compute[71689]: No targets found.
Apr 14 17:59:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 17:59:30 user nova-compute[71689]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 17:59:30 user nova-compute[71689]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71689) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6', 0)] {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf07f62-a6fd-437c-b2d5-97be94406cf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac94ee4-76a9-4bbe-a3ad-84ae9a657200]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:59:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 (non-flash)
Apr 14 17:59:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9b4c1f4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6'): ({'sdb'}, set())}) {{(pid=71689) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Removing single pathed devices sdb {{(pid=71689) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e234ae-5518-445c-85a7-98e1144e6691]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbd1bda-65ba-4b9e-ae73-98310686fd06]: (4, ('ok\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flushing IO for device /dev/sdb {{(pid=71689) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e9e44-5558-47b8-8884-03e441f780ae]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71689) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[504947ff-0d88-4179-af13-01c4f0d1049e]: (4, ('1', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.linuxscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] SCSI volumes sdb have been removed. {{(pid=71689) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6')] {{(pid=71689) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[56129bcc-444d-4ac8-b3ea-01359dcb7f0e]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --logout {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0430431d-48d6-4f18-9c7d-162e1d9e683f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260]
Apr 14 17:59:30 user nova-compute[71689]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6, portal: 172.16.0.220,3260] successful.
Apr 14 17:59:30 user nova-compute[71689]:  stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op delete {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81988) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef79d7a-ad66-4c45-bf30-e434049bd7e7]: (4, ('', '')) {{(pid=81988) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71689) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.base [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] <== disconnect_volume: return (268ms) None {{(pid=71689) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Disconnected iSCSI Volume {{(pid=71689) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 17:59:30 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Deleting instance files /opt/stack/data/nova/instances/7a094ec7-baee-4f61-99e1-33e1e45e6fda_del
Apr 14 17:59:30 user nova-compute[71689]: INFO nova.virt.libvirt.driver [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Deletion of /opt/stack/data/nova/instances/7a094ec7-baee-4f61-99e1-33e1e45e6fda_del complete
Apr 14 17:59:30 user nova-compute[71689]: INFO nova.compute.manager [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 14 17:59:30 user nova-compute[71689]: DEBUG oslo.service.loopingcall [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71689) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.compute.manager [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Deallocating network for instance {{(pid=71689) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 17:59:30 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] deallocate_for_instance() {{(pid=71689) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-vif-unplugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] No waiting events found dispatching network-vif-unplugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-vif-unplugged-b4433608-caeb-4871-adcd-2dd00c74035f for instance with task_state deleting. {{(pid=71689) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Acquiring lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] No waiting events found dispatching network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 17:59:31 user nova-compute[71689]: WARNING nova.compute.manager [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received unexpected event network-vif-plugged-b4433608-caeb-4871-adcd-2dd00c74035f for instance with vm_state active and task_state deleting.
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.network.neutron [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Updating instance_info_cache with network_info: [] {{(pid=71689) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 17:59:31 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Took 1.30 seconds to deallocate network for instance.
Apr 14 17:59:31 user nova-compute[71689]: DEBUG nova.compute.manager [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Received event network-vif-deleted-b4433608-caeb-4871-adcd-2dd00c74035f {{(pid=71689) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 17:59:32 user nova-compute[71689]: INFO nova.compute.manager [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Took 0.76 seconds to detach 1 volumes for instance.
Apr 14 17:59:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 17:59:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 17:59:32 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 17:59:32 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 17:59:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:32 user nova-compute[71689]: INFO nova.scheduler.client.report [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Deleted allocations for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda
Apr 14 17:59:32 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a094ec7-baee-4f61-99e1-33e1e45e6fda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.497s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 17:59:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:45 user nova-compute[71689]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681495170.0771039, 7a094ec7-baee-4f61-99e1-33e1e45e6fda => Stopped> {{(pid=71689) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 17:59:45 user nova-compute[71689]: INFO nova.compute.manager [-] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] VM Stopped (Lifecycle Event)
Apr 14 17:59:45 user nova-compute[71689]: DEBUG nova.compute.manager [None req-c8492514-0ff0-480e-870c-996008f72e3b None None] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Checking state {{(pid=71689) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 17:59:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 17:59:55 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:00 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:00 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Starting heal instance info cache {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:00:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Rebuilding the list of instances to heal {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:00:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Didn't find any instances for network info cache update. {{(pid=71689) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 18:00:04 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:04 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71689) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:00:05 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:00:07 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:00:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 18:00:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:00:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:00:10 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:12 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Auditing locally available compute resources for user (node: user) {{(pid=71689) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:00:13 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:00:13 user nova-compute[71689]: WARNING nova.virt.libvirt.driver [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=26.156063079833984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71689) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71689) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.compute.provider_tree [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed in ProviderTree for provider: 4b579fd6-14ac-45a2-8022-c2739351dd91 {{(pid=71689) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.scheduler.client.report [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Inventory has not changed for provider 4b579fd6-14ac-45a2-8022-c2739351dd91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71689) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG nova.compute.resource_tracker [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Compute_service record updated for user:user {{(pid=71689) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_concurrency.lockutils [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=71689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:00:13 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:15 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:18 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:00:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71689) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 18:00:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:00:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71689) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:00:20 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:23 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:23 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:25 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:28 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:30 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:35 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:00:40 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:00:42 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:45 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:00:46 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 18:00:46 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] There are 0 instances to clean {{(pid=71689) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 18:00:49 user nova-compute[71689]: DEBUG oslo_service.periodic_task [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71689) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:00:49 user nova-compute[71689]: DEBUG nova.compute.manager [None req-5355e197-37e5-4d85-93ae-8c18b6661f87 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71689) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 18:00:50 user nova-compute[71689]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71689) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}